Page History

...

KIP round-up

Next KIP Number: 471472

Use this number as the identifier for your KIP and increment this value.

...

Please insert new rows in sorted order (by KIP number).

428: Add in-memory window store425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers3420: Add Single Value Fetch in Session Stores2421: Support resolving externalized secrets in AbstractConfig dynamic 2.2.0

	KIP	Release
1	KIP-464: Defaults for AdminClient#createTopic465: Add Consolidated Connector Endpoint to Connect REST API	2.3.0 (WIP)
2	KIP-465: Add Consolidated Connector Endpoint to Connect REST API464: Defaults for AdminClient#createTopic	2.3.0 (WIP)
3	KIP-462: Use local thread id for KStreams	2.3.0
4	KIP-460: Admin Leader Election RPC	2.3.0 (WIP)
5	KIP-454: Expansion of the ConnectClusterState interface	2.3.0
6	KIP-453: Add close() method to RocksDBConfigSetter	2.3.0
7	KIP-449: Add connector contexts to log messages in Connect workers	2.3.0
8	KIP-446: Add changelog topic configuration to KTable suppress	2.3.0 (WIP)
9	KIP-445: In-memory Session Store	2.3.0
10	KIP-443: Return to default segment.ms and segment.index.bytes in Streams repartition topics	2.3.0
11	KIP-442: Return to default max poll interval in Streams	2.3.0
12	KIP-436: Add a metric indicating start time	2.3.0 (WIP)
13	KIP-417: Allow JmxTool to connect to a secured RMI port-430 - Return Authorized Operations in Describe Responses	2.3.0 (WIP)
14	KIP-415428: Incremental Cooperative Rebalancing in Kafka ConnectAdd in-memory window store	2.3.0
15	KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)	2.3.0
16	KIP-430 - Return Authorized Operations in Describe Responses425: Add some Log4J Kafka Appender Properties for Producing to Secured Brokers	2.3.0 (WIP)
17	KIP-	421: Support resolving externalized secrets in AbstractConfig	2.3.0
18	KIP-	420: Add Single Value Fetch in Session Stores	2.	2.0
19	KIP-	417: Allow JmxTool to connect to a secured RMI port	2.	3.0
20	KIP-	415: Incremental Cooperative Rebalancing in Kafka Connect	2.3.0
21	KIP-414: Expose Embedded ClientIds in Kafka Streams	2.2.0
22	KIP-412: Extend Admin API to support	dvynamic application log levels	2.3.0 (WIP)	22	KIP-414: Expose Embedded ClientIds in Kafka Streams
23	KIP-411: Make default Kafka Connect worker task client IDs distinct	2.3.0
24	KIP-402: Improve fairness in SocketServer processors	2.2.0 (WIP)
25	KIP-394: Require member.id for initial join group request	2.2.0
26	KIP-393: Time windowed serde to properly deserialize changelog input topic	2.2.0
27	KIP-386: Standardize on Min/Avg/Max metrics' default value	2.2.0
28	KIP-382: MirrorMaker 2.0	2.3.0
29	KIP-380: Detect outdated control requests and bounced brokers using broker generation	2.2.0
30	KIP-377: TopicCommand to use AdminClient	2.2.0
31	KIP-376: Implement AutoClosable on appropriate classes that want to be used in a try-with-resource statement	2.2.0
32	KIP-374: Add '--help' option to all available Kafka CLI commands	2.2.0
33	KIP-372: Naming Repartition Topics for Joins and Grouping	2.1.0
34	KIP-371: Add a configuration to build custom SSL principal name	2.2.0
35	KIP 368: Allow SASL Connections to Periodically Re-Authenticate	2.2.0
36	KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)	2.2.0
37	KIP-366: Make FunctionConversions deprecated	2.1.0
38	KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde	2.1.0
39	K IP-361: Add Consumer Configuration to Disable Auto Topic Creation	2.3.0
40	KIP-359: Verify leader epoch in produce requests	2.3.0 (WIP)
41	KIP-358: Migrate Streams API to Duration instead of long ms times	2.1.0
42	KIP-357: Add support to list ACLs per principal	2.1.0
43	KIP-356: Add withCachingDisabled() to StoreBuilder	2.1.0
44	KIP-353: Improve Kafka Streams Timestamp Synchronization	2.1.0
45	KIP-351: Add --under-min-isr option to describe topics command	2.3.0
46	KIP-346: Improve LogCleaner behavior on error	2.1
47	KIP-342 Add support for custom SASL extensions in OAuthBearer authentication	2.1.0
48	KIP-341: Update Sticky Assignor's User Data Protocol	2.3.0 (WIP)
49	KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file	2.1.0
50	KIP-339: Create a new IncrementalAlterConfigs API	2.3.0
51	KIP-338 Support to exclude the internal topics in kafka-topics.sh command	2.1.0
52	KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer	2.1.0
53	KIP-332: Update AclCommand to use AdminClient API	2.1.0
54	KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde	2.3.0 (WIP)
55	KIP-330: Add retentionPeriod in SessionBytesStoreSupplier	2.1.0
56	KIP-328: Ability to suppress updates for KTables	2.1.0 (partially implemented) / 2.3.0 (WIP)
57	KIP-324: Add method to get metrics() in AdminClient	2.1.0
58	KIP-322: Return new error code for DeleteTopics API when topic deletion disabled.	2.1.0
59	KIP-321: Update TopologyDescription to better represent Source and Sink Nodes	2.1.0
60	KIP-320: Allow fetchers to detect and handle log truncation	2.1.0 (partially implemented) / 2.2.0
61	KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier	2.1.0
62	KIP-313: Add KStream.flatTransform and KStream.flatTransformValues	2.2.0 (partially implemented) / 2.3.0
63	KIP-312 Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties	2.1.0
64	KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides	2.1.0
65	KIP-307: Allow to define custom processor names with KStreams DSL	2.3.0 (partial)
66	KIP-306: Configuration for Delaying Response to Failed Authentication	2.1.0
67	KIP-305: Add Connect primitive number converters	2.0.0
68	KIP-303: Add Dynamic Routing in Streams Sink	2.0.0
69	KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses	2.1.0
70	KIP-298: Error Handling in Connect	2.0.0
71	KIP-297: Externalizing Secrets for Connect Configurations	2.0.0
72	KIP-295 Add Streams Configuration Allowing for Optional Topology Optimization	2.0.0
73	KIP-294 - Enable TLS hostname verification by default	2.0.0
74	KIP-292: Add transformValues() method to KTable	2.0.0
75	KIP-290: Support for Prefixed ACLs	2.0.0
76	KIP-289: Improve the default group id behavior in KafkaConsumer	2.2.0
77	KIP-285: Connect Rest Extension Plugin	2.0.0
78	KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE	2.0.0
79	KIP-283: Efficient Memory Usage for Down-Conversion	2.0.0
80	KIP-282: Add the listener name to the authentication context	2.0.0
81	KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User	2.0.0
82	KIP-279: Fix log divergence between leader and follower after fast leader fail over	2.0.0
83	KIP-278 - Add version option to Kafka's commands	2.0.0
84	KIP-277 - Fine Grained ACL for CreateTopics API	2.0.0
85	KIP-276 - Add StreamsConfig prefix for different consumers	2.0.0
86	KIP-274: Kafka Streams Skipped Records Metrics	2.0.0
87	KIP-272: Add API version tag to broker's RequestsPerSec metric	2.0.0
88	KIP-270 - A Scala Wrapper Library for Kafka Streams	2.0.0
89	KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade	2.0.0
90	KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils	2.0.0
91	KIP-266: Fix consumer indefinite blocking behavior	2.0.0
92	KIP-265: Make Windowed Serde to public APIs	2.0.0
93	KIP-261: Add Single Value Fetch in Window Stores	2.0.0
94	KIP-258: Allow to Store Record Timestamps in RocksDB	2.3.0
95	KIP-257 - Configurable Quota Management	2.0.0
96	KIP-255: OAuth Authentication via SASL/OAUTHBEARER	2.0.0
97	KIP-251: Allow timestamp manipulation in Processor API	2.0.0
98	KIP-249: Add Delegation Token Operations to KafkaAdminClient	2.0.0
99	KIP-247: Add public test utils for Kafka Streams	1.1.0
100	KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor	2.0.0
101	KIP-244: Add Record Header support to Kafka Streams Processor API	2.0.0
102	KIP-243: Make ProducerConfig and ConsumerConfig constructors public	1.1.0
103	KIP-239 Add queryableStoreName() to GlobalKTable	1.1.0
104	KIP-238: Expose Kafka cluster ID in Connect REST API	1.1.0
105	KIP-237: More Controller Health Metrics	2.0.0
106	KIP-235: Add DNS alias support for secured connection	2.1.0
107	KIP-233: Simplify StreamsBuilder#addGlobalStore	1.1.0
108	KIP-231: Improve the Required ACL of ListGroups API	2.1.0
109	KIP-229: DeleteGroups API	1.1.0
110	KIP-227 - Introduce Incremental FetchRequests to Increase Partition Scalability	1.1.0
111	KIP-226 - Dynamic Broker Configuration	1.1.0
112	KIP-225 - Use tags for consumer “records.lag” metrics	1.1.0
113	KIP-224: Add configuration parameter `retries` to Streams API	1.1.0
114	KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer	2.0.0
115	KIP-222 - Add Consumer Group operations to Admin API	2.0.0
116	KIP-220: Add AdminClient into Kafka Streams' ClientSupplier	1.1.0
117	KIP-219 - Improve quota communication	2.0.0
118	KIP-218: Make KafkaFuture.Function java 8 lambda compatible	1.1.0
119	KIP-215: Add topic regex support for Connect sinks	1.1.0
120	KIP-214: Add zookeeper.max.in.flight.requests config to the broker	1.1.0
121	KIP-213 Support non-key joining in KTable	2.3.0 (WIP)
122	KIP-212: Enforce set of legal characters for connector names	1.1.0
123	KIP-211: Revise Expiration Semantics of Consumer Group Offsets	2.1.0
124	KIP-210 - Provide for custom error handling when Kafka Streams fails to produce	1.1.0
125	KIP-208: Add SSL support to Kafka Connect REST interface	1.1.0
126	KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change	2.2.0
127	KIP-206: Add support for UUID serialization and deserialization	2.1.0
128	KIP-205: Add all() and range() API to ReadOnlyWindowStore	1.1.0
129	KIP-204 : Adding records deletion operation to the new Admin Client API	1.1.0
130	KIP-203: Add toLowerCase support to sasl.kerberos.principal.to.local rule	1.1.0
131	KIP-202: Move merge() from StreamsBuilder to KStream	1.0.0
132	KIP-198: Remove ZK dependency from Streams Reset Tool	1.0.0
133	KIP-197 Connect REST API should include the connector type when describing a connector	1.0.0
134	KIP-196: Add metrics to Kafka Connect framework	1.0.0
135	KIP-195: AdminClient.createPartitions	1.0.0
136	KIP-192 : Provide cleaner semantics when idempotence is enabled	1.0.0
137	KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern	1.0.0
138	KIP-190: Handle client-ids consistently between clients and brokers	1.0.0
139	KIP-189: Improve principal builder interface and add support for SASL	1.0.0
140	KIP-188 - Add new metrics to support health checks	1.0.0
141	KIP-187 - Add cumulative count metric for all Kafka rate metrics	1.0.0
142	KIP-186: Increase offsets retention default to 7 days	2.0.0
143	KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient	2.2.0
144	KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines	1.0.0
145	KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress	1.1.0
146	KIP-177: Consumer perf tool should count rebalance time	1.0.0
147	KIP-176: Remove deprecated new-consumer option for tools	2.0.0
148	KIP-175: Additional '--describe' views for ConsumerGroupCommand	1.1.0
149	KIP-174 - Deprecate and remove internal converter configs in WorkerConfig	2.0.0
150	KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs	1.0.0
151	KIP-171 - Extend Consumer Group Reset Offset for Stream Application	1.1.0
152	KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster	1.0.0
153	KIP-167: Add interface for the state store restoration process	1.0.0
154	KIP-164 - Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics	1.0.0
155	KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch	1.0.0
156	KIP-162: Enable topic deletion by default	1.0.0
157	KIP-161: streams deserialization exception handlers	1.0.0
158	KIP-160: Augment KStream.print(), KStream.writeAsText() to allow users pass in extra parameters in the printed string	1.0.0
159	KIP-157 - Add consumer config options to streams reset tool	1.0.0
160	KIP-156 Add option "dry run" to Streams application reset tool	0.11.0.0
161	KIP-155 - Add range scan for windowed state stores	0.11.0.0
162	KIP-154 Add Kafka Connect configuration properties for creating internal topics	0.11.0.0
163	KIP-153: Include only client traffic in BytesOutPerSec metric	0.11.0.0
164	KIP-152 - Improve diagnostics for SASL authentication failures	1.0.0
165	KIP-151 Expose Connector type in REST API	0.11.0.0
166	KIP-150 - Kafka-Streams Cogroup	2.3.0 (WIP)
167	KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner	1.1.0 (partially implemented) (WIP for 2.3.0)
168	KIP-146 - Classloading Isolation in Connect	0.11.0.0
169	KIP-145 - Expose Record Headers in Kafka Connect	1.1.0
170	KIP-144: Exponential backoff for broker reconnect attempts	0.11.0.0
171	KIP-143: Controller Health Metrics	0.11.0.0
172	KIP-140: Add administrative RPCs for adding, deleting, and listing ACLs	0.11.0.0
173	KIP-138: Change punctuate semantics	1.0.0
174	KIP-137: Enhance TopicCommand --describe to show topics marked for deletion	0.11.0.0
175	KIP-136: Add Listener name to SelectorMetrics tags	0.11.0.0
176	KIP-134: Delay initial consumer group rebalance	0.11.0.0
177	KIP-133: Describe and Alter Configs Admin APIs	0.11.0.0
178	KIP-130: Expose states of active tasks to KafkaStreams public API	1.0.0
179	KIP-129: Streams Exactly-Once Semantics	0.11.0.0
180	KIP-128: Add ByteArrayConverter for Kafka Connect	0.11.0.0
181	KIP-126 - Allow KafkaProducer to split and resend oversized batches.	0.11.0.0
182	KIP-124 - Request rate quotas	0.11.0.0
183	KIP-123: Allow per stream/table timestamp extractor	0.11.0.0
184	KIP-122: Add Reset Consumer Group Offsets tooling	0.11.0.0
185	KIP-121: Add KStream peek method	0.11.0.0
186	KIP-120: Cleanup Kafka Streams builder API	1.0.0
187	KIP-119: Drop Support for Scala 2.10 in Kafka 0.11	0.11.0.0
188	KIP-118: Drop Support for Java 7	2.0.0
189	KIP-117: Add a public AdminClient API for Kafka admin operations	0.11.0.0
190	KIP-115: Enforce offsets.topic.replication.factor upon __consumer_offsets auto topic creation	0.11.0.0
191	KIP-114: KTable state stores and improved semantics	0.11.0.0
192	KIP-113: Support replicas movement between log directories	1.1.0
193	KIP-112: Handle disk failure for JBOD	1.0.0
194	KIP-110: Add Codec for ZStandard Compression	2.1.0
195	KIP-109: Old Consumer Deprecation	0.11.0.0
196	KIP-108: Create Topic Policy	0.10.2.0
197	KIP-107: Add deleteRecordsBefore() API in AdminClient	0.11.0.0
198	KIP-106 - Change Default unclean.leader.election.enabled from True to False	0.11.0.0
199	KIP-105: Addition of Record Level for Sensors	0.10.2.0
200	KIP-104: Granular Sensors for Streams	0.10.2.0
201	KIP-103: Separation of Internal and External traffic	0.10.2.0
202	KIP-102 - Add close with timeout for consumers	0.10.2.0
203	KIP-101 - Alter Replication Protocol to use Leader Epoch rather than High Watermark for Truncation	0.11.0.0
204	KIP-100 - Relax Type constraints in Kafka Streams API	0.10.2.0
205	KIP-99: Add Global Tables to Kafka Streams	0.10.2.0
206	KIP-98 - Exactly Once Delivery and Transactional Messaging	0.11.0.0
207	KIP-97: Improved Kafka Client RPC Compatibility Policy	0.10.2.0
208	KIP-96 - Add per partition metrics for in-sync and assigned replica count	0.10.2.0
209	KIP-94 Session Windows	0.10.2.0
210	KIP-93: Improve invalid timestamp handling in Kafka Streams	0.10.2.0
211	KIP-92 - Add per partition lag metrics to KafkaConsumer	0.10.2.0
212	KIP-91 Provide Intuitive User Timeouts in The Producer	2.1.0
213	KIP-90 - Remove zkClient dependency from Streams	0.10.2.0
214	KIP-89: Allow sink connectors to decouple flush and offset commit	0.10.2.0
215	KIP-88: OffsetFetch Protocol Update	0.10.2.0
216	KIP-86: Configurable SASL callback handlers	2.0.0
217	KIP-85: Dynamic JAAS configuration for Kafka clients	0.10.2.0
218	KIP-84: Support SASL SCRAM mechanisms	0.10.2.0
219	KIP-82 - Add Record Headers	0.11.0.0
220	KIP-81: Bound Fetch memory usage in the consumer	2.2.0 (WIP)
221	KIP-79 - ListOffsetRequest/ListOffsetResponse v1 and add timestamp search methods to the new consumer	0.10.1.0
222	KIP-78: Cluster Id	0.10.1.0
223	KIP-77: Improve Kafka Streams Join Semantics	0.10.2.0
224	KIP-75 - Add per-connector Converters	0.10.1.0
225	KIP-74: Add Fetch Response Size Limit in Bytes	0.10.1.0
226	KIP-73: Replication Quotas	0.10.1.0
227	KIP-72: Allow putting a bound on memory consumed by Incoming request	1.0.0
228	KIP-71: Enable log compaction and deletion to co-exist	0.10.1.0
229	KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change	0.10.1.0
230	KIP-67: Queryable state for Kafka Streams	0.10.1.0
231	KIP-66: Single Message Transforms for Kafka Connect	0.10.2.0 / 0.11.0.0
232	KIP-65: Expose timestamps to Connect	0.10.1.0
233	KIP-63: Unify store and downstream caching in streams	0.10.1.0
234	KIP-62: Allow consumer to send heartbeats from a background thread	0.10.1.0
235	KIP-60 - Make Java client classloading more flexible	0.10.1.0
236	KIP-58 - Make Log Compaction Point Configurable	0.10.1.0
237	KIP-57 - Interoperable LZ4 Framing	0.10.0.0
238	KIP-56: Allow cross origin HTTP requests on all HTTP methods	0.10.0.0
239	KIP-55: Secure Quotas for Authenticated Users	0.10.1.0
240	KIP-54: Sticky Partition Assignment Strategy	0.11.0.0
241	KIP-52: Connector Control APIs	0.10.0.0
242	KIP-51 - List Connectors REST API	0.10.0.0
243	KIP-50 - Move Authorizer to o.a.k.common package	0.10.1.0
244	KIP-48 Delegation token support for Kafka	1.1.0
245	KIP-45 - Standardize all client sequence interaction on j.u.Collection.	0.10.0.0
246	KIP-43: Kafka SASL enhancements	0.10.0.0
247	KIP-42: Add Producer and Consumer Interceptors	0.10.0.0
248	KIP-41: Consumer Max Records	0.10.0.0
249	KIP-40: ListGroups and DescribeGroup	0.9.0.0
250	KIP-38: ZooKeeper Authentication	0.9.0.0
251	KIP-36 - Rack aware replica assignment	0.10.0.0
252	KIP-35 - Retrieving protocol version	0.10.0.0
253	KIP-33 - Add a time based log index	0.10.1.0
254	KIP-32 - Add timestamps to Kafka message	0.10.0.0
255	KIP-31 - Move to relative offsets in compressed message sets	0.10.0.0
256	KIP-28 - Add a processor client	0.10.0.0
257	KIP-26 - Add Kafka Connect framework for data import/export	0.9.0.0
258	KIP-25 - System test improvements	0.9.0.0
259	KIP-22 - Expose a Partitioner interface in the new producer	0.9.0.0
260	KIP-21 - Dynamic Configuration	0.9.0.0 (WIP)
261	KIP-20 Enable log preallocate to improve consume performance under windows and some old Linux file system	0.9.0.0
262	KIP-19 - Add a request timeout to NetworkClient	0.9.0.0
263	KIP-16 - Automated Replica Lag Tuning	0.9.0.0
264	KIP-15 - Add a close method with a timeout in the producer	0.9.0.0
265	KIP-13 - Quota Design	0.9.0.0
266	KIP-12 - Kafka Sasl/Kerberos and SSL implementation	0.9.0.0
267	KIP-11 - Kafka Authorizer design	0.9.0.0
268	KIP-8 - Add a flush method to the producer API	0.9.0.0
269	KIP-4 - Metadata Protocol Changes	0.10.0.0
270	KIP-4 - Command line and centralized administrative operations	0.9.0.0, 0.10.0.0, 0.10.1.0
271	KIP-3 - Mirror Maker Enhancement	0.9.0.0
272	KIP-2 - Refactor brokers to allow listening on multiple ports and IPs	0.9.0.0
273	KIP-1 - Remove support of request.required.acks	0.9.0.0

...

Space shortcuts

Child pages

Versions Compared

Old Version 1372

New Version 1373

Key

KIP round-up