Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a list of key features/improvements/bugfixes that we can include with release notes (WIP):

  • In-order delivery with partition expansion Prefixed wildcard ACLs (KIP-290), Fine grained ACLs for CreateTopics (KIP-253)Additional functionality in AdminClient including consumer group management and config management277)
  • SASL/OAUTHBEARER implementation (KIP-255)
  • Improved quota communication and customization of quotas (KIP-219, KIP-257)
  • Efficient memory usage for down conversion (KIP-283)
  • Fix log divergence between leader and follower during fast leader failover (KIP-279)
  • Drop support for Java 7 and remove deprecated code (e.g old scala clients)
  • Connect REST extension plugin, support for externalizing secrets and improved error handling (KIP-285, KIP-297, KIP-298 etc.)
  • Scala API for Kafka Streams and other Streams API improvements (KIP-270, KIP-150, KIP-245, KIP-251 etc.)

...

Also feel free to refer to this release page for more details of the included tickets.

...

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.

KIPJIRAComponentCommitter (reviewer)
KIP-
81: Bound Fetch memory usage in the consumer
86: Configurable SASL callback handlers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
4133
4292
Consumer
Security
 
KIP-
86: Configurable SASL callback handlers
118: Drop Support for Java 7
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
4292
4423
Security 
All
KIP
-91 Provide Intuitive User Timeouts in The Producer
-174 - Deprecate and remove internal converter configs in WorkerConfig
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
5886
5540
Producer
Connect
 
KIP-
118: Drop Support for Java 7
176: Remove deprecated new-consumer option for tools

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

4423

5588

All
Tools
 
KIP-
150 - Kafka-Streams Cogroup
186: Increase offsets retention default to 7 days
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6049
3806
Streams
Broker
 
KIP-
158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
219 - Improve quota communication
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
5295
6028
Connect
Broker,Clients
Ewen Cheslack-Postava
KIP-
174 - Deprecate and remove internal converter configs in WorkerConfig
222 - Add Consumer Group operations to Admin API
Jira
showSummarytrue
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
5540
6058
Connect
AdminClient
 
KIP
-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
5692
6184
AdminClient
Consumer
 
KIP-
186: Increase offsets retention default to 7 days
237: More Controller Health Metrics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
3806
3473
Broker
 
KIP-
211: Revise Expiration Semantics of Consumer Group Offsets
244: Add Record Header support to Kafka Streams Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
4682
6850
Consumer
Streams
 
KIP-
219 - Improve quota communication
245: Use Properties instead of StreamsConfig in KafkaStreams constructor
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6028
6386
Broker,Clients
Streams
 
KIP-
222 - Add Consumer Group operations to Admin API
249: Add Delegation Token Operations to KafkaAdminClient
Jira
showSummarytrue
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6058
6447
AdminClient
 
KIP-
223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer
251: Allow timestamp manipulation in Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6184
6454
Consumer
Streams
 
KIP-
245: Use Properties instead of StreamsConfig in KafkaStreams constructor
255 OAuth Authentication via SASL/OAUTHBEARER

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

6386

6562

Streams
Security
 
KIP
-249: Add Delegation Token Operations to KafkaAdminClient
-257 - Configurable Quota Management
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6447
6576
AdminClient
Broker
 
KIP-
251: Allow timestamp manipulation in Processor API
261: Add Single Value Fetch in Window Stores
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6454
6560
Streams
 
KIP-
257 - Configurable Quota Management
265: Make Windowed Serde to public APIs
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6576
4831
Broker
Streams
 
KIP-
261: Add Single Value Fetch in Window Stores
266: Fix consumer indefinite blocking behavior
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6560
6608
Streams
Consumer
 
KIP-
265: Make Windowed Serde to public APIs
267: Add Processor Unit Test Support to Kafka Streams Test Utils
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
4831
6473
Streams
 
KIP-
267: Add Processor Unit Test Support to Kafka Streams Test Utils
268: Simplify Kafka Streams Rebalance Metadata Upgrade
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6473
6054
Streams
 
KIP
-268: Simplify
-270 - A Scala Wrapper Library for Kafka Streams
Rebalance Metadata Upgrade
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6054
6670
Streams
 
KIP-272: Add API version tag to broker's RequestsPerSec metric
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6514
Broker
 
KIP-274: Kafka Streams Skipped Records Metrics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6376
Streams
KIP-276 Add StreamsConfig prefix for different consumers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6657
Streams
KIP-277 - Fine Grained ACL for CreateTopics API

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6726

Security
KIP-278 - Add version option to Kafka's commands

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2061

Tools
 

KIP-279: Fix log divergence between leader and follower after fast leader fail over
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6361
Broker
KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6743

ToolsJason Gustafson
KIP-282: Add the listener name to the authentication context

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6750

Security
KIP-283: Efficient Memory Usage for Down-Conversion

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6927

Broker
 
KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6535
Streams
 
KIP-285: Connect Rest Extension Plugin
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6776
Connect
KIP-290: Support for Prefixed ACLs

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6841

SecurityJun Rao
KIP-292: Add transformValues() method to KTable
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6849
Streams
KIP-294 - Enable TLS hostname verification by default
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3665
Security
KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6874

Streams
KIP-297: Externalizing Secrets for Connect Configurations
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6886
Connect
KIP-298: Error Handling in Connect
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6738
Connect
KIP-303: Add Dynamic Routing in Streams Sink

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4936

Streams
KIP-305: Add Connect primitive number converters

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6913

Connect

 

Postponed to subsequent release

 

KIPJIRAComponentCommitter
KIP-81: Bound Fetch memory usage in the consumer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133

Consumer
KIP-91 Provide Intuitive User Timeouts in The Producer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886

Producer
KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
Streams
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5295
Connect
KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692

AdminClient
KIP-206: Add support for UUID serialization and deserialization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4932

ClientsEwen Cheslack-Postava
KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2334

 Broker 
KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4682

ConsumerJason Gustafson
KIP-235: Add DNS alias support for secured connection

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6195

ClientsIsmael Juma Juma
KIP-306: Configuration for Delaying Response to Failed Client Authentication

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6950

BrokerRajini Sivaram