Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

(all are in 2023)

  • KIP Freeze: 18th 22nd November (SaturdayWednesday)
    • A KIP must be accepted by this date in order to be considered for this release. Note, any KIP that may not be implemented in a week, or that might destabilize the release, should be deferred.
  • Feature Freeze: 8th 6th December (FridayWednesday)
    • major features merged & working on stabilisation, minor features have PR, release branch cut; anything not in this state will be automatically moved to the next release in JIRA
  • Code Freeze: 20th December (Wednesday)
  • At least two weeks of stabilization will follow Code Freeze, meaning we expect to release no earlier than January 3rd. We will move as fast as we can, and aim completion the earliest we can in January.

...

  • Write more unit/integration/system tests. We want to preserve the tradition of high-quality releases in Apache Kafka.
  • Improve documentation.
  • Test the release candidates. 
  • Open blocker JIRAs on critical issues found. Open non-blocker JIRAs on any other issues found.
  • Fix critical bugs.
  • Review bug fixes.
  • Vote on release candidates. Even though only PMC votes are binding, community votes are super important as we evaluate the readiness of the release.
  • Ensure that release candidates include artifacts for the new Connect test-plugins module (see
    Jira
    serverASF JIRA
    serverId5aa69414-a9e9-3523-82ec-879b028fb15b
    keyKAFKA-15249
    )

Open Issues

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject = KAFKA AND fixVersion = 3.7.0 AND status not in (resolved, closed) ORDER BY priority DESC, status DESC, updated DESC
serverId5aa69414-a9e9-3523-82ec-879b028fb15b

...

If you do not see your KIP here and want to, please reply in to the mailing list thread about the release discussion page!

KIP-963: Upload and delete lag metrics in Tiered Storage
KIPJIRAComponentStatus
KIP-405: Kafka Tiered Storage

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-7739

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15420

core

A major part went out with 3.6.0.

A minor part of the KIP is to be completed in 3.7.0. 

KIP-580: Exponential Backoff for Kafka Clients

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9800

clients

Done

KIP-714: Client metrics and observability

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15601

core

Done

A few minor improvements in the next release.

KIP-848: The Next Generation of the Consumer Rebalance Protocol

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-14048

core

KIP Accepted

Targetting a Preview in 3.7

KIP-858: Handle JBOD broker disk failure in KRaft

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-14127

core

KIP Accepted

Implementation not yet completed


KIP-890: Transactions Server-Side Defense

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-14402

core

Part 1 Completed

KIP-896: Remove old client protocol API versions in Kafka 4.0 - metrics/request log changes to identify deprecated apis

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15874

core

KIP has enough votes Nov 22, 72 hours not completed

KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum and add Controller Registration

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15230

core

KIP accepted

KIP-925: Rack aware task assignment in Kafka Streams

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15022

streams

KIP Accepted

KIP-951 - Leader discovery optimizations for the client

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15868

clients

Done

KIP-954: expand default DSL store configuration to custom types

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15215

streams

Done

KIP-959: Add BooleanConverter to Kafka Connect

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15248

connect

Done

KIP-960: Single-key single-timestamp IQv2 for state stores

Jira
serverASF JIRA
columnIdsissuekey,summary,issuetype,created,updated,duedate,assignee,reporter,priority,status,resolution
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15346

streams

Done

KIP-962: Relax non-null key requirement in Kafka Streams

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-12317

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-14748

streams

Done

KIP-963: Additional metrics in Tiered Storage

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15147

core

KIP passed vote on November 21.

Targetting 3.7

KIP-968: Support single-key_multi-timestamp Interactive Queries (IQv2) for Versioned State Stores 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15347

streams

Done

KIP-970: Deprecate and remove Connect's redundant task configurations endpoint

Partially implemented in 3.6

KIP-938: Add more metrics for measuring KRaft performance

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1518315387

coreconnect

Done (deprecation Majority was completed in 3.6. The remaining minority will be done now in 3.7.07.0, removal in 4.0.0)

KIP-580975: Exponential Backoff Docker Image for Apache Kafka Clients

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-9800

clients

Implemented

Plan to release it in 3.7.0

-15445


Done

KIP-976: Cluster-wide dynamic log adjustment for Kafka Connect

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15428

connect

Done

KIP-978: Allow dynamic reloading of certificates with different DN / SANsKIP-770: Replace "buffered.records.per.partition" & "cache.max.bytes.buffering" with "{statestore.cache}/{input.buffer}.max.bytes"

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1515815464

streamscore

DonePartly implemented, PRs open for the rest but needs reviews

KIP-858: Handle JBOD broker disk failure in KRaft979: Allow independently stop KRaft processes

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-1412715471

core

KIP Accepted

Implementation not yet completedDone

KIP-980: Allow creating connectors in a stopped state

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15470

connect

KIP is being voted on (2/3 binding so far)

Done

KIP-985: Add reverseRange and reverseAll query over kv-store in IQv2

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15527

streams

Done

KIP-988: Streams Standby Update Listener

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15448

streams

Done

KIP-992: Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15629

streams

Done

KIP-1000: List Client Metrics Configuration Resources

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15831

core

Done

KIP-1001: Add CurrentControllerId Metric

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15980

core

Done

Postponed to subsequent release

KIPJIRAComponentStatus
KIP-759: Unneeded repartition canceling


streamsKIP accepted
KIP-892: Transactional Semantics for StateStores


streamsKIP accepted
KIP-910: Update Source offsets for Source Connectors without producing records



Vote thread restarted on Nov 15 but no activity
KIP-912: Support decreasing send's block time without worrying about metadata's fetch



Vote thread started Nov 13 - no activity
KIP-913: add new method to provide possibility for accelerate first record's sending



Vote thread started Nov 13 - no activity
 KIP-953: partition method to be overloaded to accept headers as well



Vote didn't pass
KIP-956 Tiered Storage Quotas

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15265

coreDiscussion started Nov 22 (KIP Freeze Date)
KIP-967: Support custom SSL configuration for Kafka Connect RestServer



Vote didn't pass
KIP-969: Support range interactive queries (IQv2) for versioned state stores


streams
KIP-977: Partition-Level Throughput Metrics



2/3 binding votes on Nov 22 - didn't make the KIP Freeze
 KIP-982: Enhance Custom KafkaPrincipalBuilder to Access SslPrincipalMapper and KerberosShortNamer



Vote didn't pass. Just one binding vote
KIP-997: update WindowRangeQuery and unify WindowKeyQuery and WindowRangeQuery


streamsVote thread started November 17. Didn't get any votes by Nov 22
KIP-938: Add more metrics for measuring KRaft performance

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15183

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-

15147

15406

core

Under discussion.

Targetting 3.7

Postponed to subsequent release

Status

Accepted. Majority was completed in 3.6. The remaining minority was planned to be done in 3.7.0, but it slipped (no PR opened)

KIP-998: Give ProducerConfig(props, doLog) constructor protected access

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyKAFKA-15781

clients

KIP Accepted

No PR merged for 3.7. Slipped

KIPJIRAComponent