Page History

...

KIP round-up

Next KIP Number: 724725

Use this number as the identifier for your KIP and increment this value.

...

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-228 Negative record timestamp support	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-236: Interruptible Partition Reassignment	Discussion
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion	Discussion
KIP-254: JsonConverter Exception Handeling
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add end-to-end data encryption functionality to Apache Kafka	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress345
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP-370: Remove Orphan Partitions	Discussion
KIP-375: Kafka Clients - make Metadata#TOPIC_EXPIRY_MS configurable	Discussion
KIP-381: Connect: Tell about records that had their offsets flushed in callback	Voting in progress (restarted 18th January 2019, due to no votes in first attempt)
KIP-384: Add config for incompatible changes to persistent metadata	Discussion
KIP-385: Avoid throwing away prefetched data	Discussion
KIP-387: Fair Message Consumption Across Partitions in KafkaConsumer	Discussion
KIP-388: Add observer interface to record request and response	Discussion
KIP-390: Allow fine-grained configuration for compression	Discussion, JIRA exists with pull-request
KIP-395: Encypt-then-MAC Delegation token metadata
KIP-397: Add methods to override fetch offsets based on timestamp	Discussion
KIP-400: Improve exit status in case of errors in ConsoleProducer	Discussion
KIP-403: Increase ProducerPerformance precision by using nanoTime	Draft
KIP-405: Kafka Tiered Storage	Discussion
KIP-406: GlobalStreamThread should honor custom offset policy.	Blocked
KIP-407: Kafka Connect support override worker kafka api configuration with connector configuration that post by rest api
KIP-409: Allow creating under-replicated topics and partitions
KIP-410: Add metric for request handler thread pool utilization by request type	Discussion
KIP-416: Notify SourceTask of ACK'd offsets, metadata	Discussion
KIP-419: Safely notify Kafka Connect SourceTask is stopped	Voting in progress, JIRA exists with pull request
KIP-423: Add JoinReason to Consumer Join Group Protocol	Discussion
KIP-424: Allow suppression of intermediate events based on wall clock time	Discussion
KIP-426: Persist Broker Id to Zookeeper	Discussion
KIP-435: Internal Partition Reassignment Batching	Discussion
KIP-438: Expose task, connector IDs in Connect API	Discussion
KIP-439: Cleanup built-in Store interfaces	Discussion
KIP-448: Add State Stores Unit Test Support to Kafka Streams Test Utils	Discussion
KIP-452: Tool to view cluster status	Discussion, JIRA exists
KIP-468: Avoid decompression of record when validate record at server in the scene of inPlaceAssignment .	Under discussion
KIP-473: Enable KafkaLog4JAppender to use SASL Authentication Callback Handlers	Under Discussion
KIP-477: Add PATCH method for connector config in Connect REST API	Under Discussion
KIP-487: Automatic Topic Creation on Producer	Under Discussion
KIP-489: Kafka Consumer Record Latency Metric	Under Discussion
KIP-490: New metric to count offsets expired without being consumed by a consumer group	Under discussion
KIP-491: Preferred Leader Deprioritized List (Temporary Blacklist)	Under discussion
KIP-494: Connect REST Endpoint to get Transformations (SMTs)
KIP-498: Add client-side configuration for maximum response size to protect against OOM	Sent emails to Dev discussion group. Work tracked under KAFKA-4090.
KIP-499 - Unify connection name flag for command line tool	Under discussion
KIP-502: Connect SinkTask.put(...) to specify ArrayList<SinkRecord> in Signature
KIP-505: Add new public method to only update assignment metadata in consumer	Under discussion
KIP-506: Allow setting SCRAM password via Admin interface	Under discussion
KIP-508: Make Suppression State Queriable	Under discussion
KIP-509: Rebalance and restart Producers	Under discussion
KIP-510: Metrics library upgrade	Under discussion
KIP-512: Adding headers to RecordMetaData	Sent mail to dev discussion group
KIP-513: Distinguish between Key and Value serdes in scala wrapper library for kafka streams	Sent mail to dev discussion group
KIP-536: Propagate broker start time to Admin API	Under discussion
KIP-539: Add mechanism to flush records out in low volume suppression buffers	Under discussion.
KIP-540: Implement per key stream time tracking	Draft (In Progress)
KIP-542: Partition Reassignment Throttling	Draft
KIP-547: Extend ConsumerInterceptor to allow modification of Consumer Commits	Under Discussion
KIP-548 Add Option to enforce rack-aware custom partition reassignment execution	Under Discussion
KIP-549: Surface Consumer's Metadata in KafkaAdminClient#describeConsumerGroups	Under Discussion
KIP-550: Mechanism to Delete Stray Partitions on Broker	Draft
KIP-552: Suppress "unused config" warning	Under Discussion
KIP-560: Auto infer external topic partitions in stream reset tool	Under Discussion
KIP-561: Regex Support for ConsumerGroupCommand	Under Discussion
KIP-563: Add 'tail -n' feature for ConsoleConsumer	Under Discussion
KIP-564: Add new cached authorizer:change the dim of cache	Under Discussion
KIP-565: Using AclCommand,avoid call the global method loadcache in SimpleAclAuthorizer	Under Discussion
KIP-566: Add rebalance callbacks to ConsumerInterceptor	Under Discussion
KIP-567: Kafka Cluster Audit	Under Discussion
KIP-575: build a Kafka-Exporter by Java	Under Discussion
KIP-576: Support dynamic update of more broker configs related to replication	Under Discussion
KIP-578: Add configuration to limit number of partitions	Voting
KIP-579: new exception on min.insync.replicas > replication.factor	Voting in progress
KIP-581: Value of optional null field which has default value	Under Discussion
KIP-582: Add a "continue" option for Kafka Connect error handling	Under Discussion
KIP-583: add tag "partition" to BrokerTopicMetrics so as to observe the partition metrics on the same broker	Under Discussion
KIP-587: Suppress detailed responses for handled exceptions in security-sensitive environments	Under Discussion
KIP-591: Add Kafka Streams config to set default store type	Under Discussion
KIP-592: Replicate mirrormaker topics from earliest	Under Discussion
KIP-595: A Raft Protocol for the Metadata Quorum	Under Discussion
KIP-596: Safely abort Producer transactions during application shutdown	Under Discussion
KIP-598: Augment TopologyDescription with store and source / sink serde information	Under Discussion
KIP-618: Exactly-Once Support for Source Connectors	Under Discussion
KIP-619: Add internal topic creation support	Under Discussion
KIP-625: Richer encodings for integral-typed protocol fields	Under Discussion
KIP-628: ConsumerPerformance's multi-thread implementation	Sent email to Dev discussion group. Work tracked under KAFKA-10136.
KIP-634: Complementary support for headers and record metadata in Kafka Streams DSL	Under Discussion
KIP-636: Make RPC error codes and messages tagged fields	Under Discussion
KIP-637: Include min.insync.replicas in MetadataResponse to make Producer smarter in partitioning events	Draft
KIP-639: Move nodeLevelSensor and storeLevelSensor methods from StreamsMetricsImpl to StreamsMetrics	Under Discussion
KIP-640: Add log compression analysis tool	Under Discussion
KIP-641 An new java interface to replace 'kafka.common.MessageReader'	Under Discussion
KIP-649: Dynamic client configuration	Under Discussion
KIP-655: Windowed Distinct Operation for Kafka Streams API	Under Discussion
KIP-656: MirrorMaker2 Exactly-once Semantics	Draft
KIP-665: Kafka Connect Hash SMT	Voting in progress
KIP-668: Expose REST endpoint to list converter plugins	Under Discussion
KIP-669 Preserve Source Partition in Kafka Streams from context	Draft
KIP-674: API to Aggregate Metrics in Kafka Streams	Under Discussion
KIP-675: Convert a KTable to a KStream using the previous value	Under Discussion
KIP-678: New Kafka Connect SMT for plainText => struct with Regex	Under Discussion ( Sent mail )
KIP-681: Rename master key in delegation token feature	Draft
KIP-682: Connect TimestampConverter support for multiple fields and multiple input formats	Under Discussion
KIP-683: Add recursive support to Connect Cast and ReplaceField transforms, and support for casting complex types to either a native or JSON string	Under Discussion
KIP-685: Loosen permission for listing reassignments	Under Discussion
KIP-686: API to ensure Records policy on the broker	Under Discussion
KIP-687: Automatic Reloading of Security Store	Under Discussion
KIP-688: Support dynamic update of delete.topic.enable config	Under Discussion
KIP-690: Add additional configuration to control MirrorMaker 2 internal topics naming convention	Voting in progress
KIP-692: Make AdminClient value object constructors public	Under discussion
KIP-693: Client-side Circuit Breaker for Partition Write Errors	Under Discussion
KIP-694: Support Reducing Partitions for Topics	Under Discussion
KIP-697: Stricter parsing of addresses in configs	Under Discussion
KIP-701: Add --override option to bin/connect-distributed.sh	Under Discussion
KIP-702: The control plane needs to force the validation of requests from the controller	Under Discussion
KIP-703: Add a metric for reporting idle connections closed	Under Discussion
KIP-704: Indicate to broker if it is an unclean leader	Draft
KIP-705: Selectively Disable Topology Optimizations	Draft
KIP-706: Add method "Producer#produce" to return CompletionStage instead of Future	Under Discussion
KIP-707: The future of KafkaFuture	Under Discussion
KIP-709: Extend OffsetFetch requests to accept multiple group ids.	Under Discussion
KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters	Under Discussion
KIP-711 Deprecate org.apache.kafka.streams.errors.BrokerNotFoundException	Under Discussion
KIP-712: Shallow Mirroring	Under Discussion
KIP-713: Validation of Enums in configuration	Under Discussion
KIP-714: Client metrics and observability	Draft
KIP-716: Allow configuring the location of the offset-syncs topic with MirrorMaker2	Under Discussion
KIP-717: Deprecate batch-size config from console producer	Under Discussion
KIP-718: Make KTable Join on Foreign key unopinionated	Under Discussion
KIP-719: Add Log4J2 Appender	Under Discussion
KIP-720: Deprecate MirrorMaker v1	Under Discussion
KIP-721: Enable connector log contexts in Connect Log4j configuration	Under Discussion
KIP-722: Enable connector client overrides by default	Under Discussion
KIP-723: Add socket.tcp.no.delay property to Kafka Config	Under Discussion
KIP-724: Drop support for message formats v0 and v1	Under Discussion

Dormant/inactive KIPs

...

Space shortcuts

Child pages

Versions Compared

Old Version 2135

New Version 2136

Key

KIP round-up