Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

`org.apache.kafka.server.log.remote.storage.RemoteLogMetadataFormatter` can be used to format messages received from remote log metadata topic. This may be helpful for debugging purposes. Below block explains the format and it may change later. 

panel
Code Block
languagetext
titleInternal message format

<partition>:<val><sep><message-offset>:<val><sep>type:<RemoteLogSegmentMetadata | RemoteLogSegmentMetadataUpdate | DeletePartitionState><sep>version:<_no_><vs>event-value:<string representation of the event>

val: represents the respective value of the key.
sep: represents the separator, default value is: ","

partition : Remote log metata topic partition number. This is optional.
Use print.partition property to print it, default is false

message-offset : Offset of this message in remote log metadata topic. This is optional.
Use print.message.offset property to print it, default is false

type: Event value type, which can be one of RemoteLogSegmentMetadata, RemoteLogSegmentMetadataUpdate, DeletePartitionState values.

version: Version number of the event value type. This is optional.
Use print.version property to print it, default is false

Use
<p>&lt;partition&gt;:&lt;val&gt;&lt;sep&gt;&lt;message-offset&gt;:&lt;val&gt;&lt;sep&gt;type:&lt;RemoteLogSegmentMetadata | RemoteLogSegmentMetadataUpdate | DeletePartitionState&gt;&lt;sep&gt;version:&lt;_no_&gt;&lt;vs&gt;event-value:&lt;string representation of the event&gt;</p><p>val: represents the respective value of the key. <br />sep: represents the separator, default value is: &quot;,&quot;</p><p>partition : Remote log metata topic partition number. This is optional. <br />Use print.partition property to print it, default is false</p><p>message-offset : Offset of this message in remote log metadata topic. This is optional. <br />Use print.message.offset property to print it, default is false</p><p>type: Event value type, which can be one of RemoteLogSegmentMetadata, RemoteLogSegmentMetadataUpdate, DeletePartitionState values.</p><p>version: Version number of the event value type. This is optional. <br />Use print.version property to print it, default is false</p><p>Use print.all.event.value.fields to print the string representation of the event which will include all the fields in the data, default property value is false.

Event value can be of any of the types below:

For RemoteLogSegmentMetadata
default representation is
</p><p>Event value can be of any of the types below:</p><p>For RemoteLogSegmentMetadata <br />default representation is remote-log-segment-id
:<val><sep>start-offset:<val><sep>end-offset:<val><sep>leader-epoch:<val><sep>
:&lt;val&gt;&lt;sep&gt;start-offset:&lt;val&gt;&lt;sep&gt;end-offset:&lt;val&gt;&lt;sep&gt;leader-epoch:&lt;val&gt;&lt;sep&gt; remote-log-segment-state:
<COPY
&lt;COPY_SEGMENT_STARTED | COPY_SEGMENT_FINISHED | DELETE_SEGMENT_STARTED | DELETE_SEGMENT_
FINISHED>For RemoteLogSegmentMetadataUpdate
default representation is
FINISHED&gt;</p><p>For RemoteLogSegmentMetadataUpdate<br />default representation is remote-log-segment-id:
<val><sep>leader
&lt;val&gt;&lt;sep&gt;leader-epoch:
<val><sep>remote
&lt;val&gt;&lt;sep&gt;remote-log-segment-state:
<COPY
&lt;COPY_SEGMENT_STARTED | COPY_SEGMENT_FINISHED | DELETE_SEGMENT_STARTED | DELETE_SEGMENT_
FINISHED>For DeletePartitionState
default representation is
FINISHED&gt;</p><p>For DeletePartitionState<br />default representation is topic-id-partition:
<val><sep>epoch:<val><sep>remote
&lt;val&gt;&lt;sep&gt;epoch:&lt;val&gt;&lt;sep&gt;remote-partition-delete-state:
<DELETE
&lt;DELETE_PARTITION_MARKED | DELETE_PARTITION_STARTED | DELETE_PARTITION_
FINISHED>
FINISHED&gt;</p>


Anchor
topic-deletion
topic-deletion
Topic deletion lifecycle

...