Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This is a list of key features/improvements/bugfixes that we can include with release notes (WIP):

  • Efficient memory usage for down conversion Prefixed wildcard ACLs (KIP-290), Fine grained ACLs for CreateTopics (KIP-283)Additional functionality in AdminClient including consumer group management and config management277)
  • SASL/OAUTHBEARER implementation (KIP-255)
  • Improved quota communication and management customization of quotas (KIP-219, KIP-257)
  • Efficient memory usage for down conversion (KIP-283)
  • Fix log divergence between leader and follower during fast leader failover (KIP-279)
  • Drop support for Java 7 and remove deprecated code (e.g old scala clients)
  • Connect REST extension plugin, support for externalizing secrets and improved error handling (KIP-285, KIP-297, KIP-298 etc.)
  • Scala API for Kafka Streams and other Streams API improvements (KIP-270, KIP-150, KIP-245, KIP-251 etc.)

...

  • Write more unit/integration/system testsWe want to preserve the tradition of high-quality releases in Apache Kafka.
  • Improve documentation
  • Test the release candidates
  • Open blocker JIRAs on critical issues found. Open non-blocker JIRAs on any other issues found.
  • Fix critical bugs
  • Review bug fixes
  • Vote on RCs. Even though only PMC votes are binding, community votes are super important as we evaluate the readiness of the release

Open Issues

...

Jira
 
server
Key
ASF JIRA
SummaryTCreatedUpdatedDueAssigneeReporterPStatusResolution

 

columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject = KAFKA AND fixVersion = 2.0.0 AND status not in (resolved, closed) ORDER BY priority DESC, status DESC, updated DESC
serverId5aa69414-a9e9-3523-82ec-879b028fb15b

Also feel free to refer to this release page for more details of the included tickets.

...

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.

KIPJIRAComponentCommitter (reviewer)
KIP
-81: Bound Fetch memory usage in the consumer JiraserverASF JIRAserverId5aa69414
-
a9e9-3523-82ec-879b028fb15bkeyKAFKA-4133Consumer KIP-
86: Configurable SASL callback handlers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4292
Security
 
KIP-
KIP-91 Provide Intuitive User Timeouts in The Producer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886
Producer KIP-
118: Drop Support for Java 7
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4423
All
 
KIP-
150 - Kafka-Streams Cogroup
174 - Deprecate and remove internal converter configs in WorkerConfig
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6049
5540
Streams
Connect
 
KIP-
174 - Deprecate and remove internal converter configs in WorkerConfig
176: Remove deprecated new-consumer option for tools

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

5540

5588

Connect
Tools
 
KIP-
183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient
186: Increase offsets retention default to 7 days
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
5692
3806
AdminClient
Broker
 
KIP-
186: Increase offsets retention default to 7 days
219 - Improve quota communication
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
3806
6028
Broker,Clients
 
KIP-
211: Revise Expiration Semantics of
222 - Add Consumer Group
Offsets
operations to Admin API
Jira
showSummarytrue
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
4682
6058
Consumer
AdminClient
 
KIP
-219 - Improve quota communication
-223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6028
6184
Broker,Clients
Consumer
 
KIP-
222 - Add Consumer Group operations to Admin API
237: More Controller Health Metrics
Jira
showSummarytrue
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6058
3473
AdminClient
Broker
 
KIP-
223 - Add per-topic min lead and per-partition lead metrics to KafkaConsumer
244: Add Record Header support to Kafka Streams Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-
6184
6850
Consumer
Streams
 
KIP-245: Use Properties instead of StreamsConfig in KafkaStreams constructor
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6386
Streams
 
KIP-249: Add Delegation Token Operations to KafkaAdminClient
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6447
AdminClient
 
KIP-251: Allow timestamp manipulation in Processor API
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6454
Streams
KIP-255 OAuth Authentication via SASL/OAUTHBEARER

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6562

Security
 

KIP-257 - Configurable Quota Management
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6576
Broker
 
KIP-261: Add Single Value Fetch in Window Stores
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6560
Streams
 
KIP-265: Make Windowed Serde to public APIs
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4831
Streams
KIP-266: Fix consumer indefinite blocking behavior
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6608
Consumer
 
KIP-267: Add Processor Unit Test Support to Kafka Streams Test Utils
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6473
Streams
 
KIP-268: Simplify Kafka Streams Rebalance Metadata Upgrade
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6054
Streams
 
KIP-270 - A Scala Wrapper Library for Kafka Streams
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6670
Streams
KIP-272: Add API version tag to broker's RequestsPerSec metric
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6514
Broker
 
KIP-274: Kafka Streams Skipped Records Metrics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6376
Streams
KIP-276 Add StreamsConfig prefix for different consumers
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6657
Streams
KIP-277 - Fine Grained ACL for CreateTopics API

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6726

Security
KIP-278 - Add version option to Kafka's commands

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2061

Tools
 

KIP-279: Fix log divergence between leader and follower after fast leader fail over
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6361
Broker
Broker
KIP-281: ConsumerPerformance: Increase Polling Loop Timeout and Make It Reachable by the End User

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6743

ToolsJason Gustafson
KIP-282: Add the listener name to the authentication context

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6750

Security
KIP-283: Efficient Memory Usage for Down-Conversion

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6927

Broker
 

KIP-284: Set default retention ms for Streams repartition topics to Long.MAX_VALUE
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6535
Streams
 

 

...

KIP-285: Connect Rest Extension Plugin
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6776
Connect
KIP-290: Support for Prefixed ACLs

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6841

SecurityJun Rao
KIP-292: Add transformValues() method to KTable
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6849
Streams
KIP-294 - Enable TLS hostname verification by default
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-3665
Security
KIP-295: Add Streams Configuration Allowing for Optional Topology Optimization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6874

Streams
KIP-297: Externalizing Secrets for Connect Configurations
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6886
Connect
KIP-298: Error Handling in Connect
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6738
Connect
KIP-303: Add Dynamic Routing in Streams Sink

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4936

Streams
KIP-305: Add Connect primitive number converters

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6913

Connect

 

Postponed to subsequent release

 

KIPJIRAComponentCommitter
KIP-81: Bound Fetch memory usage in the consumer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4133

Consumer
KIP-91 Provide Intuitive User Timeouts in The Producer

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5886

Producer
KIP-150 - Kafka-Streams Cogroup
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6049
Streams
KIP-158: Kafka Connect should allow source connectors to set topic-specific settings for new topics
Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5295
Connect
KIP-183 - Change PreferredReplicaLeaderElectionCommand to use AdminClient

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-5692

AdminClient
KIP-206: Add support for UUID serialization and deserialization

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4932

ClientsEwen Cheslack-Postava
KIP-207: Offsets returned by ListOffsetsResponse should be monotonically increasing even during a partition leader change

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-2334

 Broker 
KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-4682

ConsumerJason Gustafson
KIP-235: Add DNS alias support for secured connection

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6195

ClientsIsmael Juma Juma
KIP-306: Configuration for Delaying Response to Failed Client Authentication

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-6950

BrokerRajini Sivaram