Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a list of key features/improvements/bugfixes that we can include with release notes (WIP):

  • In-order delivery with partition expansion Prefixed wildcard ACLs (KIP-290), Fine grained ACLs for CreateTopics (KIP-253277)
  • Additional functionality in AdminClient including consumer group management and config management
  • SASL/OAUTHBEARER implementation (KIP-255)
  • Improved quota communication and customization of quotas (KIP-219, KIP-257)
  • Efficient memory usage for down conversion (KIP-283)
  • Fix log divergence between leader and follower during fast leader failover (KIP-279)
  • Drop support for Java 7 and remove deprecated code (e.g old scala clients)
  • Connect REST extension plugin, support for externalizing secrets and improved error handling (KIP-285, KIP-297, KIP-298 etc.)
  • Scala API for Kafka Streams and other Streams API improvements (KIP-270, KIP-150, KIP-245, KIP-251 etc.)

...

Also feel free to refer to this release page for more details of the included tickets.

...

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.

KIP-81: Bound Fetch memory usage in the consumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133
ConsumerJason Gustafson
KIPJIRAComponentCommitter
(reviewer)
KIP-86: Configurable SASL callback handlers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4292
Security
Rajini Sivaram
KIP-
91 Provide Intuitive User Timeouts in The Producer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886
Producer KIP-
118: Drop Support for Java 7
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
All
 KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
StreamsMatthias Sax
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5295
Connect
KIP-174 - Deprecate and remove internal converter configs in WorkerConfig
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5540
Connect
KIP-
183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
176: Remove deprecated new-consumer option for tools

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

5692

5588

AdminClient
Tools
Jun Rao

KIP-186: Increase offsets retention default to 7 days
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3806
BrokerJason GustafsonKIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change Jiraserver
ASF JIRAserverId5aa69414-a9e9-3523-82ec-879b028fb15bkeyKAFKA-2334KIP-211: Revise Expiration Semantics of Consumer Group Offsets
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4682
Consumer
Broker
 
KIP-219 - Improve quota communication
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6028
Broker,Clients
KIP-222 - Add Consumer Group operations to Admin API
Jira
showSummarytrue
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6058
AdminClient
KIP-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6184
Consumer
KIP-237: More Controller Health Metrics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3473
Broker
KIP-244: Add Record Header support to Kafka Streams Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6850
Streams
KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6386
Streams
KIP-249: Add Delegation Token Operations to KafkaAdminClient
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6447
AdminClient
KIP-251: Allow timestamp manipulation in Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6454
Streams
KIP-255 OAuth Authentication via SASL/OAUTHBEARER

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6562

Security
KIP-257 - Configurable Quota Management
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6576
Broker
Rajini Sivaram
KIP-261: Add Single Value Fetch in Window Stores
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6560
Streams
KIP-265: Make Windowed Serde to public APIs
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4831
Streams
KIP-266: Fix consumer indefinite blocking behavior
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6608
Consumer
KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6473
Streams
KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6054
Streams
KIP-270 - A Scala Wrapper Library for Kafka Streams
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6670
Streams
KIP-272: Add API version tag to broker's RequestsPerSec metric
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6514
Broker
KIP-274: Kafka Streams Skipped Records Metrics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6376
Streams
KIP-276 Add StreamsConfig prefix for different consumers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6657
Streams
KIP-277 - Fine Grained ACL for CreateTopics API

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6726

Security
KIP-278 - Add version option to Kafka's commands

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2061

Tools
KIP-279: Fix log divergence between leader and follower after fast leader fail over
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6361
Broker
KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6743

ToolsJason Gustafson
KIP-282: Add the listener name to the authentication context

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6750

Security
KIP-283: Efficient Memory Usage for Down-Conversion

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6927

Broker
KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6535
Streams
KIP-285: Connect Rest Extension Plugin
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6776
Connect
KIP-290: Support for Prefixed ACLs

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6841

SecurityJun Rao
KIP-292: Add transformValues() method to KTable
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6849
Streams
KIP-294 - Enable TLS hostname verification by default
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3665
Security
KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6874

Streams
KIP-297: Externalizing Secrets for Connect Configurations
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6886
Connect
KIP-298: Error Handling in Connect
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6738
Connect
KIP-303: Add Dynamic Routing in Streams Sink

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4936

Streams
KIP-305: Add Connect primitive number converters

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6913

Connect

 

Postponed to subsequent release

 

KIPJIRAComponentCommitter
KIP-81: Bound Fetch memory usage in the consumer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133

Consumer
KIP-91 Provide Intuitive User Timeouts in The Producer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886

Producer
KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
Streams
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5295
Connect
KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692

AdminClient
KIP-206: Add support for UUID serialization and deserialization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4932

ClientsEwen Cheslack-Postava
KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2334

 Broker 
KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4682

ConsumerJason Gustafson
KIP-235: Add DNS alias support for secured connection

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6195

ClientsIsmael Juma Juma
KIP-306: Configuration for Delaying Response to Failed Client Authentication

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6950

BrokerRajini Sivaram