Release Dates

  • KIP Freeze: Sep 24, 2018 (a KIP must be accepted by this date in order to be considered for this release)
  • Feature Freeze: Oct 1, 2018 (major features merged & working on stabilization, minor features have PR, release branch cut; anything not in this state will be automatically moved to the next release in JIRA)
  • Code Freeze: Oct 15, 2018
  • Release: Nov 20, 2018


These dates are goals and subject to change, but we expect to stay on the Time Based Release Plan unless unexpected critical issues come up. While the target release date is fixed at ~2w after code freeze, RCs will roll out as needed until the release vote passes.

The release manager is Dong Lin.

Release Features

This is a list of key features/improvements/bugfixes that we can include with release notes:

  • Java 11 support
  • Support for Zstandard, which achieves compression comparable to gzip with higher compression and especially decompression speeds (KIP-110)
  • Avoid expiring committed offsets for active consumer group (KIP-211)
  • Provide Intuitive User Timeouts in The Producer (KIP-91)
  • Kafka's replication protocol now supports improved fencing of zombies. Previously, under certain rare conditions, if a broker became partitioned from Zookeeper but not the rest of the cluster, then the logs of replicated partitions could diverge and cause data loss in the worst case (KIP-320).

  • Streams API improvements (KIP-319, KIP-321, KIP-330, KIP-353, KIP-356)
  • Admin script and admin client API improvements to simplify admin operation (KIP-231, KIP-308, KIP-322, KIP-324, KIP-338, KIP-340)
  • DNS handling improvements (KIP-235, KIP-302)

How to Contribute

Before code freeze:

  • Participate in votes and discussions to land or postpone the open KIPs.
  • Review patches. We anticipate that this release will be bottlenecked mostly on reviews. The more reviewers, the more content we can fit in.
  • Write unit/integration/system tests. We want to preserve the tradition of high-quality releases in Apache Kafka. 

After code freeze:

  • Write more unit/integration/system testsWe want to preserve the tradition of high-quality releases in Apache Kafka.
  • Improve documentation
  • Test the release candidates
  • Open blocker JIRAs on critical issues found. Open non-blocker JIRAs on any other issues found.
  • Fix critical bugs
  • Review bug fixes
  • Vote on RCs. Even though only PMC votes are binding, community votes are super important as we evaluate the readiness of the release

Open Issues

key summary type created updated due assignee reporter priority status resolution

JQL and issue key arguments for this macro require at least one Jira application link to be configured

Also feel free to refer to this release page for more details of the included tickets.

Planned KIP Content

Note: The planned content is not binding - final content will be based the features committed by branch-cutting date. See Kafka Improvement Proposals for the full list of KIPs.

KIPJIRAComponentCommitter (reviewer)Comment

KIP-91 Provide Intuitive User Timeouts in The Producer

Unable to render Jira issues macro, execution error.

Clients
KIP-110: Add Codec for ZStandard Compression

Unable to render Jira issues macro, execution error.

Broker, Clients
KIP-206: Add support for UUID serialization and deserialization

Unable to render Jira issues macro, execution error.

Clients
KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Unable to render Jira issues macro, execution error.

Broker, Clients
KIP-231: Improve the Required ACL of ListGroups API

Unable to render Jira issues macro, execution error.

Security
KIP-235: Add DNS alias support for secured connection

Unable to render Jira issues macro, execution error.

Clients
KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

Unable to render Jira issues macro, execution error.

Clients
KIP-306: Configuration for Delaying Response to Failed Client Authentication

Unable to render Jira issues macro, execution error.

Client
KIP-308: Support dynamic update of max.connections.per.ip/max.connections.per.ip.overrides configs

Unable to render Jira issues macro, execution error.

Broker
KIP-312: Add Overloaded StreamsBuilder Build Method to Accept java.util.Properties

Unable to render Jira issues macro, execution error.

Streams
KIP-319: Replace segments with segmentInterval in WindowBytesStoreSupplier

Unable to render Jira issues macro, execution error.

Streams
KIP-321: Update TopologyDescription to better represent Source and Sink Nodes

Unable to render Jira issues macro, execution error.

Streams
KIP-322: Return new error code for DeleteTopics API when topic deletion disabled

Unable to render Jira issues macro, execution error.

Tools
KIP-324: Add method to get metrics() in AdminClient

Unable to render Jira issues macro, execution error.

AdminClient
KIP-328: Ability to suppress updates for KTables

Unable to render Jira issues macro, execution error.

StreamsMatthias Saxpartially implemented in v2.1
KIP-330: Add retentionPeriod in SessionBytesStoreSupplier

Unable to render Jira issues macro, execution error.

Streams
KIP-332: Update AclCommand to use AdminClient API

Unable to render Jira issues macro, execution error.

Tools
KIP-336: Consolidate ExtendedSerializer/Serializer and ExtendedDeserializer/Deserializer

Unable to render Jira issues macro, execution error.

Clients
KIP-338 Support to exclude the internal topics in kafka-topics.sh command

Unable to render Jira issues macro, execution error.

Tools
KIP-340: Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

Unable to render Jira issues macro, execution error.

Tools
KIP-342: Add support for Custom SASL extensions in OAuthBearer authentication

Unable to render Jira issues macro, execution error.

Security
KIP-353: Improve Kafka Streams Timestamp Synchronization

Unable to render Jira issues macro, execution error.

Streams
KIP-356: Add withCachingDisabled() to StoreBuilder

Unable to render Jira issues macro, execution error.

StreamsMatthias Sax
KIP-357: Add support to list ACLs per principal

Unable to render Jira issues macro, execution error.

Tools
KIP-358: Migrate Streams API to Duration instead of long ms times

Unable to render Jira issues macro, execution error. Unable to render Jira issues macro, execution error.

Streams
KIP-365: Materialized, Serialized, Joined, Consumed and Produced with implicit Serde

Unable to render Jira issues macro, execution error.

Streams
KIP-366: Make FunctionConversions deprecated

Unable to render Jira issues macro, execution error.

Streams
KIP-372: Naming Repartition Topics for Joins and Grouping

Unable to render Jira issues macro, execution error.

Streams

 

Postponed to subsequent release

 

KIPJIRAComponentCommitterComment
KIP-81: Bound Fetch memory usage in the consumer

Unable to render Jira issues macro, execution error.

Clients
KIP-149: Enabling key access in ValueTransformer, ValueMapper, and ValueJoiner

Unable to render Jira issues macro, execution error.

Streams
partially implemented in v1.1
KIP-150 - Kafka-Streams Cogroup

Unable to render Jira issues macro, execution error.

Streams

KIP-289: Improve the default group id behavior in KafkaConsumer

Unable to render Jira issues macro, execution error.

Clients

KIP-313: Add KStream.flatTransform and KStream.flatTransformValues

Unable to render Jira issues macro, execution error.

Streams
KIP-320: Allow fetchers to detect and handle log truncation

Unable to render Jira issues macro, execution error.

Broker,Clients
KIP-328: Ability to suppress updates for KTables

Unable to render Jira issues macro, execution error.

Streamspartially implemented in v2.1
KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

Unable to render Jira issues macro, execution error.

Core, Streams

KIP-339: Create a new IncrementalAlterConfigs API

Unable to render Jira issues macro, execution error.

AminClient
KIP-341: Update Sticky Assignor's User Data Protocol

Unable to render Jira issues macro, execution error.

Clients
KIP-359: Verify leader epoch in produce requests

Unable to render Jira issues macro, execution error.

Broker,Clients

KIP-361: Add Consumer Configuration to Disable Auto Topic Creation

Unable to render Jira issues macro, execution error.

Clients

KIP-367 Introduce close(Duration) to Producer and AdminClient instead of close(long, TimeUnit)

Unable to render Jira issues macro, execution error.

Clients,AdminClient

KIP-368: Allow SASL Connections to Periodically Re-Authenticate

Unable to render Jira issues macro, execution error.

Broker,Clients
  • No labels