Page History

...

Metrics are to be sent as CUMULATIVE values, rather than DELTA, which allows for missed/dropped transmits without data loss.

Serialized size

As an example, the serialized size prior to compression of all producer and standard metrics defined in this KIP for a producer producing to 50 partitions gives approximately 100 kB.

Compression

As metric names and labels are highly repetative it is recommended that the serialized metrics are compressed prior to sending them to the broker if the serialized uncompressed size exceeds 1000 bytes.

...

Preliminary tests indicate that a compression ratio up to 10x is possible for the standard metrics using LZ4ZStd.

Decompression of the metrics data will be performed by the broker prior to passing the data to the metrics plugin.

...