Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Update configuration to set a reasonable default memory for record batching.

...

Public Interfaces

New configuration:

NameDefaultDescription
statestore.uncommitted.max.records

...

-1Maximum number of uncommitted state-store records to buffer per-task. If this limit is exceeded, a task commit will be requested. No limit: -1

...

.

...

statestore.uncommitted.max.bytes

...

67108864 (64 MB)

Maximum number of memory bytes to be used to buffer uncommitted state-store records per-task. If this limit is exceeded, a task commit will be requested. No limit: -1

...

.

Note: if this is too high or unbounded, it's possible for RocksDB to trigger out-of-memory errors.

Changed:

  • org.apache.kafka.streams.processor.StateStore

...