Versions Compared

Old Version 27

changes.mady.by.user guozhang Wang

Saved on

compared with

New Version Current

changes.mady.by.user Ismael Juma Juma

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a list of key features/improvements/bugfixes that we can include with release notes (WIP):

  • Java 9 support with significantly faster TLS and CRC32C implementations
  • JBOD improvements: disk failure disables the failed disk instead of the broker (KIP-112/KIP-113 part 1)
  • Idempotent producer supports a maximum of 5 in-flight requests per connection instead of 1
  • Improved metrics (KIP-164, KIP-168, KIP-187, KIP-188, KIP-196) and logging
  • Improve diagnostics for SASL and SSL authentication failures (KIP-152
  • Drop support of Java 7 (KIP-118)
  • JBOD support for disk failures (KIP-112)
  • Kafka Streams API improvements (KIP-120 / 130 / 138 / 150 / 160 / 161), and drop compatibility "Evolving" annotations 

...

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.Ismael Juma Juma

5aa69414-a9e9-3523-82ec-879b028fb15b

 KIPJIRAComponentCommitter
12KIP-48 Delegation token support for Kafka
Jira
serverASF JIRA
serverId
keyKAFKA-1696
Security KIP-72: Allow putting a bound on memory consumed by Incoming request 
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4602
NetworkJun Rao
324KIP-81: Bound Fetch memory usage in the consumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133
Consumer KIP-112: Handle disk failure for JBOD
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4763
Broker Jun Rao
53KIP-113: Support replicas movement between log directories (part 1)

Jira
serverASF JIRA

columns

key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

5136

5694

Broker

 Jun Rao

6KIP-118: Drop Support for Java 7 in Kafka 0.11
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
Buildguozhang Wang

Jiangjie Qin

47KIP-120: Cleanup Kafka Streams builder API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3856
Streamsguozhang Wang85KIP 130: Expose states of active tasks to KafkaStreams public API
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4819
Streamsguozhang Wang96KIP-138: Change punctuate semantics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5233
StreamsDamian Guy10711KIP-150 - Kafka-Streams CogroupTBD (Kyle Winkelman)Streamsguozhang Wang KIP-152 - Improve diagnostics for SASL authentication failures
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4764
Security

Jun Rao (broker)

Rajini Sivaram (client)

8

KIP 157 - Add consumer config options to streams reset tool

Jira
serverASF JIRAcolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-52335225
SecurityIsmael Juma JumaStreamsDamian Guy912KIP-160: Augment KStream.print(), KStream.writeAsText()
Jira
serverASF JIRAcolumnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-47644830
StreamsDamian Guy1310KIP-161: streams deserialization exception handlers
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5157
StreamsDamian Guy1411KIP-162: Enable topic deletion by default
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5384
AdminGwen Shapira1512KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4585
SecurityEwen Cheslack-Postava1613KIP-164- Add UnderMinIsrPartitionCount and per-partition UnderMinIsr metrics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5341
BrokerEwen Cheslack-Postava1714KIP-167: Add interface for the state store restoration process
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5363
Streamsguozhang Wang1815KIP-168: Add GlobalTopicCount and GlobalPartitionCount metric per cluster
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5461
BrokerJason Gustafson1916KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3741
StreamsDamian Guy2017KIP-177: Consumer perf tool should count rebalance time
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5358
ToolingJason Gustafson2118KIP-182: Reduce Streams DSL overloads and allow easier use of custom storage engines
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5651
Streamsguozhang Wang2219KIP-187 - Add cumulative count metric for all Kafka rate metrics
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5738
MetricsIsmael Juma Juma20KIP-188 - Add new metrics to support health checks
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5746
MetricsIsmael Juma Juma21KIP-189: Improve principal builder interface and add support for SASL
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5783
BrokerRajini Sivaram22KIP-190: Handle client-ids consistently between clients and brokers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5735
BrokerRajini Sivaram23KIP-191: KafkaConsumer.subscribe() overload that takes just Pattern
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5726
ConsumerJason Gustafson24KIP-192 : Provide cleaner semantics when idempotence is enabled
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5793
Producer/BrokerJason Gustafson25KIP-195: AdminClient.createPartitions
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5856
AdminIsmael Juma Juma26KIP-196: Add metrics to Kafka Connect framework
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2376
ConnectEwen Cheslack-Postava27KIP-197 Connect REST API should include the connector type when describing a connector
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5657
ConnectEwen Cheslack-Postava28KIP-198: Remove ZK dependency from Streams Reset Tool
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5862
Toolingguozhang Wang29KIP-202 Move merge() from StreamsBuilder to KStream
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5765
StreamsGuozhang Wang

Postponed to subsequent release

 KIPJIRAComponentCommitter
1KIP-48 Delegation token support for Kafka
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1696
Security ?
2KIP-81: Bound Fetch memory usage in the consumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133
ConsumerJason Gustafson
3KIP-91 Provide Intuitive User Timeouts in The Producer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886
Producer

Jiangjie Qin

4KIP-113: Support replicas movement between log directories (part 2)
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5163
BrokerJun Rao
5KIP-118: Drop Support for Java 7
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
Buildguozhang Wang
6KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
Streamsguozhang Wang
7KIP-180: Add a broker metric specifying the number of consumer group rebalances in progress
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5565
BrokerJason Gustafson
8KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692
Tools/BrokerIsmael Juma Juma