THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| Code Block |
|---|
{
"apiKey": 4,
"type": "request",
"listeners": ["zkBroker"],
"name": "LeaderAndIsrRequest",
"validVersions": "0-7", <-- New version 7
"flexibleVersions": "4+",
"fields": [
{ "name": "ControllerId", "type": "int32", "versions": "0+", "entityType": "brokerId",
"about": "The controller id." },
--> { "name": "KRaftControllerId", "type": "int32", "versions": "7+", "entityType": "brokerId",
"about": "The KRaft controller id, used during migration." }, <-- New field
{ "name": "ControllerEpoch", "type": "int32", "versions": "0+",
"about": "The controller epoch." },
...
]
} |
...
| Code Block |
|---|
{
"apiKey": 5,
"type": "request",
"listeners": ["zkBroker"],
"name": "StopReplicaRequest",
"validVersions": "0-4", <-- New version 4
"flexibleVersions": "2+",
"fields": [
{ "name": "ControllerId", "type": "int32", "versions": "0+", "entityType": "brokerId",
"about": "The controller id." },
--> { "name": "KRaftControllerId", "type": "int32", "versions": "4+", "entityType": "brokerId",
"about": "The KRaft controller id, used during migration." }, // <-- New field
{ "name": "ControllerEpoch", "type": "int32", "versions": "0+",
"about": "The controller epoch." },
...
]
} |
...
| Code Block |
|---|
{
"apiKey": 6,
"type": "request",
"listeners": ["zkBroker"],
"name": "UpdateMetadataRequest",
"validVersions": "0-8", <-- New version 8
"flexibleVersions": "6+",
"fields": [
{ "name": "ControllerId", "type": "int32", "versions": "0+", "entityType": "brokerId",
"about": "The controller id." },
--> { "name": "KRaftControllerId", "type": "int32", "versions": "8+", "entityType": "brokerId",
"about": "The KRaft controller id, used during migration." }, // <-- New field
{ "name": "ControllerEpoch", "type": "int32", "versions": "0+",
"about": "The controller epoch." },
...
]
} |
...
| Code Block |
|---|
{
"apiKey": 18,
"type": "response",
"name": "ApiVersionsResponse",
"validVersions": "0-4", // <-- New version 4
"flexibleVersions": "3+",
"fields": [
// ...
{ "name": "ZkMigrationReady", "type": "int8", "versions": "4+", "taggedVersions": "4+", "tag": 3, "ignorable": true,
"about": "Set by a KRaft controller if the required configurations for ZK migration are present" } // <-- New field
]
} |
This field will only be set by the KRaft controller when sending ApiVersionsResponse to other KRaft controllers. Since this migration does not support combined mode KRaft nodes, this field will never be seen by clients when receiving ApiVersionsResponse sent by brokers.
...
| Code Block |
|---|
{
"apiKey":62,
"type": "request",
"listeners": ["controller"],
"name": "BrokerRegistrationRequest",
"validVersions": "0-1", // <-- New version 1
"flexibleVersions": "0+",
"fields": [
//
--> ...
{ "name": "ZkMigrationReady", "type": "int8", "versions": "1+", "taggedVersions": "1+", "tag": 1, "ignorable": true,
"about": "Set by a ZK broker if the required configurations for ZK migration are present." } // <--- newNew field
]
} |
RegisterBrokerRecord
A new field is added to signify that a registered broker is a ZooKeeper broker.
| Code Block |
|---|
{
"apiKey": 0,
"type": "metadata",
"name": "RegisterBrokerRecord",
"validVersions": "0-2", // <-- New version 2
"flexibleVersions": "0+",
"fields": [
...
{ "{ "name": "ZkMigrationReadyBrokerId", "type": "int8int32", "versions": "2+", "taggedVersions0+", "entityType": "brokerId",
"about": "The broker id." },
{ "name": "IsZkBroker", "type": "2+bool", "tagversions": 1"2+", "ignorabledefault": truefalse,
"about": "Set byTrue if the registering broker is a ZK broker." if the required configurations for ZK migration are present" }}, // <-- New field
// ...
]
} |
Migration State ZNode
As part of the propagation of KRaft metadata back to ZooKeeper while in dual-write mode, we need to keep track of what has been synchronized. A new ZNode will be introduced to keep track of which KRaft record offset has been written back to ZK. This will be used to recover the synchronization state following a KRaft controller failover.
...
| Code Block |
|---|
{
"version": 2, // <-- New version 2
"brokerid": 3000,
"timestamp": 1234567890,
"isKRaft": true // <-- newNew field
} |
This field is intended to be informational to aid with debugging.
...