DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
| Table of Contents |
|---|
Status
Current state: Under DiscussionDiscussion thread: hereAccepted
Discussion thread: https://lists.apache.org/thread/dvc6pp2h5oxo4bcq1mnfbs02z0g7pk61
Voting thread: https://lists.apache.org/thread/nqkv6ckppz5o6s9h1ls3qzhlmwchxqn1
JIRA: KAFKA-12392
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
kafka-console-producer.sh- The option Using the
--max-partition-memory-bytesoption will display a warning:"Warning: --max-partition-memory-bytes is deprecated and will be marked as deprecated and then removed in the next major release.removed in a future version. Use --batch-size instead."
- The option Using the
Proposed Changes
- Correct the inaccurate description of
--batch-sizeto reflect that it controls byte size, not message count - Mark
--max-partition-memory-bytesas deprecated, directing users to--batch-sizeinstead. To maintain backward compatibility, the existing behavior where
--max-partition-memory-bytesoverrides overrides--batch-sizewill will be preserved until the deprecated option is removed.
...
| Code Block |
|---|
./kafka-console-producer.sh
This tool helps to read data from standard input and publish it to Kafka.
Option Description
------ -----------
--batch-size <Integer: size> The buffer size in bytes allocated for a partition.
When records are received
which are smaller than this size the
producer will attempt to
optimistically group them together
until this size is reached. This is
the option to control `batch.size`
in producer configs. (default: 16384)
please note that this option will be
replaced if max-partition-memory-bytes
is also set.
--max-partition-memory-bytes <Integer: (Deprecated) The buffer size allocated for a partition.
memory in bytes per partition> When records are received
which are smaller than this size the
producer will attempt to
optimistically group them together
until this size is reached. This is
the option to control `batch.size`
in producer configs. (default: 16384)
This option will be removed in a
future version. Use --batch-size instead.
./kafka-console-producer.sh --topic test --bootstrap-server localhost:9092 --max-partition-memory-bytes 16384
Warning: --max-partition-memory-bytes is deprecated and will be removed in a future version. Use --batch-size instead. |
Compatibility, Deprecation, and Migration Plan
...
This was rejected because keeping the dedicated --batch-size flag is more convenient for users who frequently test the interaction between batch.size and linger.ms .
Note: The recent KIP-1147 unified option names across many tools. It replaced --producer-property and --consumer-property with a consistent --command-property, and unified file-based options into --command-config.