Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a list of key features/improvements/bugfixes that we can include with release notes (WIP):

  • Java 9 support with significantly faster TLS and CRC32C implementations
  • JBOD improvements: disk failure disables the failed disk instead of the broker (KIP-112/KIP-113 part 1)
  • Idempotent producer supports a maximum of 5 in-flight requests per connection instead of 1
  • Improved metrics (KIP-164, KIP-168, KIP-187, KIP-188, KIP-196) and logging
  • Improve diagnostics for SASL and SSL authentication failures (KIP-152
  • Drop support of Java 7 (KIP-118)
  • JBOD support for disk failures (KIP-112)
  • Kafka Streams API improvements (KIP-120 / 130 / 138 / 150 / 160 / 161), and drop compatibility "Evolving" annotations 

...

 ?
 KIPJIRAComponentCommitter
1KIP-48 Delegation token support for Kafka
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1696
Security2KIP-72: Allow putting a bound on memory consumed by Incoming request 
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4602
NetworkJun Rao
3KIP-81: Bound Fetch memory usage in the consumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133
Consumer Jason Gustafson
4KIP-91 Provide Intuitive User Timeouts in The ProducerTBDProducer

Jiangjie Qin

2KIP-5KIP-112: Handle disk failure for JBOD
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4763
Broker Jun Rao
63KIP-113: Support replicas movement between log directories (part 1)

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

5163

5694

Broker

 Jun Rao

7KIP-118: Drop Support for Java 7 in Kafka 0.11
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
Buildguozhang Wang

Jiangjie Qin

48KIP-120: Cleanup Kafka Streams builder API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3856
Streamsguozhang Wang
95KIP 130: Expose states of active tasks to KafkaStreams public API
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4819
Streamsguozhang Wang
106KIP-138: Change punctuate semantics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5233
StreamsDamian Guy
11712KIP-150 - Kafka-Streams CogroupTBD (Kyle Winkelman)Streamsguozhang Wang KIP-152 - Improve diagnostics for SASL authentication failures
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4764
Security

Jun Rao (broker)

Rajini Sivaram (client)

8

KIP 157 - Add consumer config options to streams reset tool

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5225
StreamsDamian Guy
913KIP-160: Augment KStream.print(), KStream.writeAsText()
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4830
StreamsDamian Guy
1410KIP-161: streams deserialization exception handlers
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5157
StreamsDamian Guy
1511KIP-162: Enable topic deletion by default
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5384
AdminGwen Shapira
1612KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4585
SecurityEwen Cheslack-Postava
1713KIP-164- Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5341
BrokerEwen Cheslack-Postava
1814KIP-167: Add interface for the state store restoration process
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5363
Streamsguozhang Wang
1915KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5461
BrokerJason Gustafson
2016KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3741
StreamsDamian Guy
2117KIP-177: Consumer perf tool should count rebalance time
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5358
ToolingJason Gustafson
2218KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5651
Streamsguozhang Wang
23KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692
AdminIsmael Juma Juma
1924KIP-187 - Add cumulative count metric for all Kafka rate metrics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5738
MetricsIsmael Juma Juma
2520KIP-188 - Add new metrics to support health checks
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5746
MetricsIsmael Juma Juma
2621KIP-189: Improve principal builder interface and add support for SASL
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5783
BrokerRajini Sivaram
2722KIP-190: Handle client-ids consistently between clients and brokers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5735
BrokerIsmael Juma JumaRajini Sivaram
2328KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5726
ConsumerJason Gustafson
2924KIP-192 : Provide cleaner semantics when idempotence is enabled
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5793
Producer/BrokerJason Gustafson
3025KIP-195: AdminClient.createPartitions
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5856
AdminIsmael Juma Juma
3126KIP-196: Add metrics to Kafka Connect framework
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2376
ConnectGwen ShapiraEwen Cheslack-Postava
2732KIP-197 Connect REST API should include the connector type when describing a connector
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5657
ConnectEwen Cheslack-Postava
3328KIP-198: Remove ZK dependency from Streams Reset Tool
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5862
Toolingguozhang Wang
29KIP-202 Move merge() from StreamsBuilder to KStream
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5765
StreamsGuozhang Wang

Postponed to subsequent release

 KIPJIRAComponentCommitter
1KIP-48 Delegation token support for Kafka
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1696
Security ?
2KIP-81: Bound Fetch memory usage in the consumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133
ConsumerJason Gustafson
3KIP-91 Provide Intuitive User Timeouts in The Producer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886
Producer

Jiangjie Qin

4KIP-113: Support replicas movement between log directories (part 2)
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5163
BrokerJun Rao
5KIP-118: Drop Support for Java 7
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
Buildguozhang Wang
6KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
Streamsguozhang Wang
7KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5565
BrokerJason Gustafson
8KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692
Tools/BrokerIsmael Juma Juma