Page History

...

	KIP	Release
1	KIP-372: Naming Joins and Grouping Repartition Topics	2.1.0 (WIP)
2	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.1.0
3	KIP-110: Add Codec for ZStandard Compression	2.1.0
4	KIP-366: Make FunctionConversions deprecated	2.1.0
5	KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.1.0
6	K IP-361: Add Consumer Configuration to Disable Auto Topic Creation	2.1.0 (WIP)
7	KIP-359: Verify leader epoch in produce requests	2.1.0
8	KIP-357: Add support to list ACLs per principal	2.1.0
9	KIP-356: Add withCachingDisabled() to StoreBuilder	2.1.0
10	KIP-353: Improve Kafka Streams Timestamp Synchronization	2.1.0
11	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication	2.1.0 (WIP)
12	KIP-341: Update Sticky Assignor's User Data Protocol	2.1.0 (WIP)
13	KIP-338 Support to exclude the internal topics in kafka-topics.sh command	2.1.0
14	KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
15	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.1.0 (WIP)
16	KIP-332: Update AclCommand to use AdminClient API	2.1.0
17	KIP-330: Add retentionPeriod in SessionBytesStoreSupplier	2.1.0
18	KIP-328: Ability to suppress updates for KTables	2.1.0
19	KIP-324: Add method to get metrics() in AdminClient	2.1.0
20	KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.	2.1.0
21	KIP-321: Update TopologyDescription to better represent Source and Sink Nodes	2.1.0
22	KIP-320: Allow fetchers to detect and handle log truncation	2.1.0
23	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.1.0
24	KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.1.0
25	KIP-306: Configuration for Delaying Response to Failed Authentication	2.1.0
26	KIP-305: Add Connect primitive number converters	2.0.0
27	KIP-303: Add Dynamic Routing in Streams Sink	2.0.0
28	KIP-298: Error Handling in Connect	2.0.0
29	KIP-297: Externalizing Secrets for Connect Configurations	2.0.0
30	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
31	KIP-294 - Enable TLS hostname verification by default	2.0.0
32	KIP-292: Add transformValues() method to KTable	2.0.0
33	KIP-290: Support for Prefixed ACLs	2.0.0
34	KIP-289: Improve the default group id behavior in KafkaConsumer	2.1.0 (WIP)
35	KIP-285: Connect Rest Extension Plugin	2.0.0
36	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0.0
37	KIP-283: Efficient Memory Usage for Down-Conversion	2.0.0
38	KIP-282: Add the listener name to the authentication context	2.0.0
39	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0.0
40	KIP-279: Fix log divergence between leader and follower after fast leader fail over	2.0.0
41	KIP-278 - Add version option to Kafka's commands	2.0.0
42	KIP-277 - Fine Grained ACL for CreateTopics API	2.0.0
43	KIP-276 - Add StreamsConfig prefix for different consumers	2.0.0
44	KIP-274: Kafka Streams Skipped Records Metrics	2.0.0
45	KIP-272: Add API version tag to broker's RequestsPerSec metric	2.0.0
46	KIP-270 - A Scala Wrapper Library for Kafka Streams	2.0.0
47	KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.0.0
48	KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils	2.0.0
49	KIP-266: Fix consumer indefinite blocking behavior	2.0.0
50	KIP-265: Make Windowed Serde to public APIs	2.0.0
51	KIP-261: Add Single Value Fetch in Window Stores	2.0.0
52	KIP-257 - Configurable Quota Management	2.0.0
53	KIP-255: OAuth Authentication via SASL/OAUTHBEARER	2.0.0
54	KIP-251: Allow timestamp manipulation in Processor API	2.0.0
55	KIP-249: Add Delegation Token Operations to KafkaAdminClient	2.0.0
56	KIP-247: Add public test utils for Kafka Streams	1.1.0
57	KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.0.0
58	KIP-244: Add Record Header support to Kafka Streams Processor API	2.0.0
59	KIP-243: Make ProducerConfig and ConsumerConfig constructors public	1.1.0
60	KIP-239 Add queryableStoreName() to GlobalKTable	1.1.0
61	KIP-238: Expose Kafka cluster ID in Connect REST API	1.1.0
62	KIP-237: More Controller Health Metrics	2.0.0
63	KIP-233: Simplify StreamsBuilder#addGlobalStore	1.1.0
64	KIP-231: Improve the Required ACL of ListGroups API	2.1.0 (WIP)
65	KIP-229: DeleteGroups API	1.1.0
66	KIP-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.1.0
67	KIP-226 - Dynamic Broker Configuration	1.1.0
68	KIP-225 - Use tags for consumer “records.lag” metrics	1.1.0
69	KIP-224: Add configuration parameter `retries` to Streams API	1.1.0
70	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	2.0.0
71	KIP-222 - Add Consumer Group operations to Admin API	2.0.0
72	KIP-220: Add AdminClient into Kafka Streams' ClientSupplier	1.1.0
73	KIP-219 - Improve quota communication	2.0.0
74	KIP-218: Make KafkaFuture.Function java 8 lambda compatible	1.1.0
75	KIP-215: Add topic regex support for Connect sinks	1.1.0
76	KIP-214: Add zookeeper.max.in.flight.requests config to the broker	1.1.0
77	KIP-212: Enforce set of legal characters for connector names	1.1.0
78	KIP-211: Revise Expiration Semantics of Consumer Group Offsets	2.1.0 (WIP)
79	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce	1.1.0
80	KIP-208: Add SSL support to Kafka Connect REST interface	1.1.0
81	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.0.0 (WIP)
82	KIP-206: Add support for UUID serialization and deserialization	2.1.0
83	KIP-205: Add all() and range() API to ReadOnlyWindowStore	1.1.0
84	KIP-204 : Adding records deletion operation to the new Admin Client API	1.1.0
85	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.1.0
86	KIP-202: Move merge() from StreamsBuilder to KStream	1.0.0
87	KIP-198: Remove ZK dependency from Streams Reset Tool	1.0.0
88	KIP-197 Connect REST API should include the connector type when describing a connector	1.0.0
89	KIP-196: Add metrics to Kafka Connect framework	1.0.0
90	KIP-195: AdminClient.createPartitions	1.0.0
91	KIP-192 : Provide cleaner semantics when idempotence is enabled	1.0.0
92	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
93	KIP-190: Handle client-ids consistently between clients and brokers	1.0.0
94	KIP-189: Improve principal builder interface and add support for SASL	1.0.0
95	KIP-188 - Add new metrics to support health checks	1.0.0
96	KIP-187 - Add cumulative count metric for all Kafka rate metrics	1.0.0
97	KIP-186: Increase offsets retention default to 7 days	2.0.0
98	KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.0.0
99	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.0
100	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0
101	KIP-177: Consumer perf tool should count rebalance time	1.0.0
102	KIP-176: Remove deprecated new-consumer option for tools	2.0.0
103	KIP-175: Additional '--describe' views for ConsumerGroupCommand	1.1.0
104	KIP-174 - Deprecate and remove internal converter configs in WorkerConfig	2.0.0
105	KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.0
106	KIP-171 - Extend Consumer Group Reset Offset for Stream Application	1.1.0
107	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.0
108	KIP-167: Add interface for the state store restoration process	1.0.0
109	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.0
110	KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch	1.0.0
111	KIP-162: Enable topic deletion by default	1.0.0
112	KIP-161: streams deserialization exception handlers	1.0.0
113	KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
114	KIP-157 - Add consumer config options to streams reset tool	1.0.0
115	KIP-156 Add option "dry run" to Streams application reset tool	0.11.0.0
116	KIP-155 - Add range scan for windowed state stores	0.11.0.0
117	KIP-154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
118	KIP-153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
119	KIP-152 - Improve diagnostics for SASL authentication failures	1.0.0
120	KIP-151 Expose Connector type in REST API	0.11.0.0
121	KIP-150 - Kafka-Streams Cogroup	2.1.0 (WIP)
122	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.1.0)
123	KIP-146 - Classloading Isolation in Connect	0.11.0.0
124	KIP-145 - Expose Record Headers in Kafka Connect	1.1.0
125	KIP-144: Exponential backoff for broker reconnect attempts	0.11.0.0
126	KIP-143: Controller Health Metrics	0.11.0.0
127	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0
128	KIP-138: Change punctuate semantics	1.0.0
129	KIP-137: Enhance TopicCommand --describe to show topics marked for deletion	0.11.0.0
130	KIP-136: Add Listener name to SelectorMetrics tags	0.11.0.0
131	KIP-134: Delay initial consumer group rebalance	0.11.0.0
132	KIP-133: Describe and Alter Configs Admin APIs	0.11.0.0
133	KIP-130: Expose states of active tasks to KafkaStreams public API	1.0.0
134	KIP-129: Streams Exactly-Once Semantics	0.11.0.0
135	KIP-128: Add ByteArrayConverter for Kafka Connect	0.11.0.0
136	KIP-126 - Allow KafkaProducer to split and resend oversized batches.	0.11.0.0
137	KIP-124 - Request rate quotas	0.11.0.0
138	KIP-123: Allow per stream/table timestamp extractor	0.11.0.0
139	KIP-122: Add Reset Consumer Group Offsets tooling	0.11.0.0
140	KIP-121: Add KStream peek method	0.11.0.0
141	KIP-120: Cleanup Kafka Streams builder API	1.0.0
142	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11	0.11.0.0
143	KIP-118: Drop Support for Java 7	2.0.0
144	KIP-117: Add a public AdminClient API for Kafka admin operations	0.11.0.0
145	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.11.0.0
146	KIP-114: KTable state stores and improved semantics	0.11.0.0
147	KIP-113: Support replicas movement between log directories	1.1.0
148	KIP-112: Handle disk failure for JBOD	1.0.0
149	KIP-109: Old Consumer Deprecation	0.11.0.0
150	KIP-108: Create Topic Policy	0.10.2.0
151	KIP-107: Add deleteRecordsBefore() API in AdminClient	0.11.0.0
152	KIP-106 - Change Default unclean.leader.election.enabled from True to False	0.11.0.0
153	KIP-105: Addition of Record Level for Sensors	0.10.2.0
154	KIP-104: Granular Sensors for Streams	0.10.2.0
155	KIP-103: Separation of Internal and External traffic	0.10.2.0
156	KIP-102 - Add close with timeout for consumers	0.10.2.0
157	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.11.0.0
158	KIP-100 - Relax Type constraints in Kafka Streams API	0.10.2.0
159	KIP-99: Add Global Tables to Kafka Streams	0.10.2.0
160	KIP-98 - Exactly Once Delivery and Transactional Messaging	0.11.0.0
161	KIP-97: Improved Kafka Client RPC Compatibility Policy	0.10.2.0
162	KIP-96 - Add per partition metrics for in-sync and assigned replica count	0.10.2.0
163	KIP-94 Session Windows	0.10.2.0
164	KIP-93: Improve invalid timestamp handling in Kafka Streams	0.10.2.0
165	KIP-92 - Add per partition lag metrics to KafkaConsumer	0.10.2.0
166	KIP-91 Provide Intuitive User Timeouts in The Producer	2.1.0
167	KIP-90 - Remove zkClient dependency from Streams	0.10.2.0
168	KIP-89: Allow sink connectors to decouple flush and offset commit	0.10.2.0
169	KIP-88: OffsetFetch Protocol Update	0.10.2.0
170	KIP-86: Configurable SASL callback handlers	2.0.0
171	KIP-85: Dynamic JAAS configuration for Kafka clients	0.10.2.0
172	KIP-84: Support SASL SCRAM mechanisms	0.10.2.0
173	KIP-82 - Add Record Headers	0.11.0.0
174	KIP-81: Bound Fetch memory usage in the consumer	2.0.0 (WIP)
175	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
176	KIP-78: Cluster Id	0.10.1.0
177	KIP-77: Improve Kafka Streams Join Semantics	0.10.2.0
178	KIP-75 - Add per-connector Converters	0.10.1.0
179	KIP-74: Add Fetch Response Size Limit in Bytes	0.10.1.0
180	KIP-73: Replication Quotas	0.10.1.0
181	KIP-72: Allow putting a bound on memory consumed by Incoming request	1.0.0
182	KIP-71: Enable log compaction and deletion to co-exist	0.10.1.0
183	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.1.0
184	KIP-67: Queryable state for Kafka Streams	0.10.1.0
185	KIP-66: Single Message Transforms for Kafka Connect	0.10.2.0 / 0.11.0.0
186	KIP-65: Expose timestamps to Connect	0.10.1.0
187	KIP-63: Unify store and downstream caching in streams	0.10.1.0
188	KIP-62: Allow consumer to send heartbeats from a background thread	0.10.1.0
189	KIP-60 - Make Java client classloading more flexible	0.10.1.0
190	KIP-58 - Make Log Compaction Point Configurable	0.10.1.0
191	KIP-57 - Interoperable LZ4 Framing	0.10.0.0
192	KIP-56: Allow cross origin HTTP requests on all HTTP methods	0.10.0.0
193	KIP-55: Secure Quotas for Authenticated Users	0.10.1.0
194	KIP-54: Sticky Partition Assignment Strategy	0.11.0.0
195	KIP-52: Connector Control APIs	0.10.0.0
196	KIP-51 - List Connectors REST API	0.10.0.0
197	KIP-50 - Move Authorizer to o.a.k.common package	0.10.1.0
198	KIP-48 Delegation token support for Kafka	1.1.0
199	KIP-45 - Standardize all client sequence interaction on j.u.Collection.	0.10.0.0
200	KIP-43: Kafka SASL enhancements	0.10.0.0
201	KIP-42: Add Producer and Consumer Interceptors	0.10.0.0
202	KIP-41: Consumer Max Records	0.10.0.0
203	KIP-40: ListGroups and DescribeGroup	0.9.0.0
204	KIP-38: ZooKeeper Authentication	0.9.0.0
205	KIP-36 - Rack aware replica assignment	0.10.0.0
206	KIP-35 - Retrieving protocol version	0.10.0.0
207	KIP-33 - Add a time based log index	0.10.1.0
208	KIP-32 - Add timestamps to Kafka message	0.10.0.0
209	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
210	KIP-28 - Add a processor client	0.10.0.0
211	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
212	KIP-25 - System test improvements	0.9.0.0
213	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
214	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
215	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
216	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
217	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
218	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
219	KIP-13 - Quota Design	0.9.0.0
220	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
221	KIP-11 - Kafka Authorizer design	0.9.0.0
222	KIP-8 - Add a flush method to the producer API	0.9.0.0
223	KIP-4 - Metadata Protocol Changes	0.10.0.0
224	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
225	KIP-3 - Mirror Maker Enhancement	0.9.0.0
226	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
227	KIP-1 - Remove support of request.required.acks	0.9.0.0

...

KIP	Comment
KIP-59: Proposal for a kafka broker command	Sent emails to Dev discussion group. Work tracked under KAFKA-3663.
KIP-125: ZookeeperConsumerConnector to KafkaConsumer Migration and Rollback
KIP-131 - Add access to OffsetStorageReader from SourceConnector
KIP-135 : Send of null key to a compacted topic should throw non-retriable error back to user
KIP 141 - ProducerRecord & SourceRecord: Add timestamp constructors
KIP-142: Add ListTopicsRequest to efficiently list all the topics in a cluster
KIP-148: Add a connect timeout for client
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
KIP-159: Introducing Rich functions to Streams
KIP-165: Extend Interactive Queries for return latest update timestamp per key
KIP-166 - Add a tool to make amounts of replicas and leaders on brokers balanced
KIP-169 - Lag-Aware Partition Assignment Strategy
KIP-178: Size-based log directory selection strategy
KIP-185: Make exactly once in order delivery the default producer setting
KIP-193: Add SchemaBuilder.from(Schema)
KIP-199: Add Kafka Connect offset tool
KIP-201: Rationalising Policy interfaces
KIP-209: C onnection String Support
KIP-213 Support non-key joining in KTable
KIP-216: IQ should throw different exceptions for different errors
KIP-217: Expose a timeout to allow an expired ZK session to be re-created
KIP-221: Repartition Topic Hints in Streams
KIP-228 Negative record timestamp support	Voting in progress
KIP 230: Name Windowing Joins	Discussion
KIP-232: Detect outdated metadata using per-partition leaderEpoch field	Voting in progress
KIP-234: add support for getting topic defaults from AdminClient
KIP-235: Add DNS alias support for secured connection	Accepted
KIP-236: Interruptible Partition Reassignment
KIP-240: AdminClient.listReassignments() AdminClient.describeReassignments()
KIP-242: Mask password in Kafka Connect Rest API response
KIP-248 - Create New ConfigCommand That Uses The New AdminClient	Voting in progress (pending on more binding votes)
KIP-250 Add Support for Quorum-based Producer Acknowledgment
KIP-252 - Extend ACLs to allow filtering based on ip ranges and subnets
KIP-253: Support in-order message delivery with partition expansion
KIP-254: JsonConverter Exception Handeling
KIP-258: Allow to Store Record Timestamps in RocksDB	depends on KIP-268
KIP-259: Improve Streams DSL Timestamp Propagation Semantics
KIP-260: add primary join operation for Stream-Stream join (WIP)	Draft
KIP-262: Metadata should include number of state stores for task	depends on KIP-268
KIP-264: Add a consumer metric to record raw fetch size	Voting in progress
KIP-271: Add NetworkClient redirector	Discussion
KIP-273: Kafka to support using ETCD beside Zookeeper	Discussion
KIP-275 - Indicate "isClosing" in the SinkTaskContext	Voting in progress
KIP-280: Enhanced log compaction	Discussion
KIP-291: Separating controller connections and requests from the data plane	Voting in progress
KIP-293 Add new metrics for consumer/replication fetch requests	Voting in progress
KIP-296: Add connector level configurability for producer/consumer client configs	Discussion
KIP-300: Add Windowed KTable API in StreamsBuilder	Discussion
KIP-301: Schema Inferencing for JsonConverter	Discussion
KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses	Discussion
KIP-304: Connect runtime mode improvements for container platforms	Discussion
KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	Accepted
KIP-313: Add KStream.flatTransform and KStream.flatTransformValues	Accepted
KIP-314: KTable to GlobalKTable Bi-directional Join	Discussion
KIP-315: Stream Join Sticky Assignor	Discussion
KIP-316: Command-line overrides for ConnectDistributed worker properties	Discussion
KIP-317: Add transparent data encryption functionality	Discussion
KIP-320: Allow fetchers to detect and handle log truncation	Discussion
KIP-325: Extend Consumer Group Command to Show Beginning Offsets	Voting in Progress
KIP-326: Schedulable KTable as Graph source	Discussion
KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde
KIP-333: Add faster mode of rebalancing	Discussion
KIP-334 - Include partitions in exceptions raised during consumer record deserialization/validation
KIP-335: Consider configurations for KafkaStreams	Discussion
KIP-339: Create a new IncrementalAlterConfigs API
KIP-345: Reduce multiple consumer rebalances by specifying member id
KIP-346 - Improve LogCleaner behavior on error
KIP-347: Enable batching in FindCoordinatorRequest	Discussion
KIP-348 Eliminate null from SourceTask#poll()
KIP-350: Allow kafka-topics.sh to take brokerid as parameter to show partitions associated with it
KIP-351: Add --critical-partitions option to describe topics command	Discussion
KIP-354: Add a Maximum Log Compaction Lag	Discussion
KIP-356: Add KafkaConsumer fetch-error-rate and fetch-error-total metrics	Discussion
KIP-358: Migrate Streams API to Duration instead of long ms times	Accepted
KIP-360: Improve handling of unknown producer	Discussion
K IP-362: Support Dynamic Session Window	Discussion
KIP-363: Allow performance tools to print final results to output file	Discussion
KIP 368: Allow SASL Connections to Periodically Re-Authenticate	Discussion
KIP-370: Remove Orphan Partitions
KIP-371: Add a configuration to build custom SSL principal name	Discussion
KIP-373374: Add '--help' option to all available Kafka CLI commands	Discussion

Dormant/inactive KIPs

...

Space shortcuts

Child pages

Versions Compared

Old Version 1086

New Version 1087

Key