THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| Code Block | ||
|---|---|---|
| ||
compression.type=gzip
compression.config=gzip.level:4,gzip.buffer.size:8192,snappy.buffer.size:32768,lz4.level:9,lz4.buffer.size:4,zstd.level:3 # NEW |
The available KEYs are: gzip.level, gzip.buffer.size, snappy.buffer.size, lz4.level, lz4.buffer.size, zstd.level. For available values per each key, please refer 'Compression level' and 'Compression buffer size' subsection under 'Proposed Changes'.
...
The valid range and default value of compression level and buffer size are entirely up to the compression library, so they may be changed in the future. As of June 2019, their current values are like the following:
Compression level
| Compression Codec | availability | Valid Range | Default |
|---|---|---|---|
| gzip | Yes | 1 (Deflater.BEST_SPEED) ~ 9 (Deflater.BEST_COMPRESSION) | 6 |
| snappy | No | - | - |
| lz4 | Yes | 1 ~ 17 | 9 |
| zstd | Yes | -131072 ~ 22 | 3 |
Compression buffer size
| Compression Codec | availability | Valid Range | Default | Note |
|---|---|---|---|---|
| gzip | Yes | Positive Integer | 8192 (8kb) | Kafka's own default. |
| snappy | Yes | Positive Integer | 32768 (32kb) | Library default. |
| lz4 | Yes | 4 ~ 7 (4=64kb, 5=256kb, 6=1mb, 7=4mb) | 4 (64kb) | Kafka's own default. |
| zstd | No | - | - | - |
Compatibility, Deprecation, and Migration Plan
...