...
The format
sub-command in the kafka-storage.sh
tool will include two new properties when producing meta.properties
: directory.id
and directory.ids
. This sub-command already supports formatting more than one log directory — by expecting a list of configured log.dirs
— and "formatting" only the ones that need so. All configured log directories must be available for kafka-storage.sh
format to run successfully.
meta.properties
The To avoid issues when downgrading, the meta.properties
version version field will be bumped from kept at 1 to 2. Two new properties directory.id
and directory.ids
will be added to the meta.properties
file in each log directory, including the metadata.log.dir
. The first property, directory.id
indicates the UUID for the log directory where the file is located, the second property, directory.ids
lists all the UUIDs for all the configured log directories. If the meta.properties
file doesn't exist for the metadata.log.dir
the Kafka node will fail to start. If the meta.properties
file exists but it doesn't contain these two properties a new one will be generated and the meta.properties
files will be updated. The kafka-storage.sh
tool will be extended to generate or update the two properties as described in the previous section.
...