Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

`org.apache.kafka.server.log.remote.storage.RemoteLogMetadataFormatter` can be used to format messages received from remote log metadata topic. This may be helpful for debugging purposes. Below block explains the format and it may change later. 

No Formatpanel
titleInternal message formatcollapsetrue

<partition>:<val><sep><message-offset>:<val><sep>type:<RemoteLogSegmentMetadata

|

RemoteLogSegmentMetadataUpdate

|

DeletePartitionState><sep>version:<_no_><vs>event-value:<string

representation

of

the

event>

val:

represents

the

respective

value

of

the

key.


sep:

represents

the

separator,

default

value

is:

","

partition

:

Remote

log

metata

topic

partition

number.

This

is

optional.


Use

print.partition

property

to

print

it,

default

is

false

message-offset

:

Offset

of

this

message

in

remote

log

metadata

topic.

This

is

optional.


Use

print.message.offset

property

to

print

it,

default

is

false

type:

Event

value

type,

which

can

be

one

of

RemoteLogSegmentMetadata,

RemoteLogSegmentMetadataUpdate,

DeletePartitionState

values.

version:

Version

number

of

the

event

value

type.

This

is

optional.


Use

print.version

property

to

print

it,

default

is

false

Use

print.all.event.value.fields

to

print

the

string

representation

of

the

event

which

will

include

all

the

fields

in

the

data,

default

property

value

is

false.

Event

value

can

be

of

any

of

the

types

below:

For

RemoteLogSegmentMetadata


default

representation

is

remote-log-segment-id:<val><sep>start-offset:<val><sep>end-offset:<val><sep>leader-epoch:<val><sep>

remote-log-segment-state:<COPY_SEGMENT_STARTED

|

COPY_SEGMENT_FINISHED

|

DELETE_SEGMENT_STARTED

|

DELETE_SEGMENT_FINISHED>

For

RemoteLogSegmentMetadataUpdate


default

representation

is

remote-log-segment-id:<val><sep>leader-epoch:<val><sep>remote-log-segment-state:<COPY_SEGMENT_STARTED

|

COPY_SEGMENT_FINISHED

|

DELETE_SEGMENT_STARTED

|

DELETE_SEGMENT_FINISHED>

For

DeletePartitionState


default

representation

is

topic-id-partition:<val><sep>epoch:<val><sep>remote-partition-delete-state:<DELETE_PARTITION_MARKED

|

DELETE_PARTITION_STARTED

|

DELETE_PARTITION_FINISHED>


Anchor
topic-deletion
topic-deletion
Topic deletion lifecycle

...