This page is meant as a template for writing a KIP. To create a KIP choose Tools->Copy on this page and modify with your content and replace the heading with the next KIP number and a description of your issue. Replace anything in italics with your own description.
Status
Current state: Under Discussion
Discussion thread: here
JIRA: here
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Motivation
We want to introduce --files to the producer command line tool to support reading data from a given multi-file,
Multiple files are separated by --files-separator, the default comma is the separator.
Public Interfaces
kafka-console-producer.sh:
The producer command will accept --files and --files-separator options.
Implement FileMessageReader for the MessageReader interface,The original LineMessageReader will still be the default reader.
When the --files option is used, it will switch to FileMessageReader.
E.g
1.The content in the 1.txt file is:
a
b
c
2.The content in the 2.txt file is:
1
2
3
3.Execute producer command line tool:
./bin/kafka-console-producer.sh --bootstrap-server `hostname`:9092 --topic test-01 --files 1.txt,2.txt
4.Execute consumer command line tool:
./bin/kafka-console-consumer.sh --bootstrap-server `hostname`:9092 --topic test-01 --from-beginning
console output:
a
b
c
1
2
3
Proposed Changes
Compatibility, Deprecation, and Migration Plan
The new options have no effect on existing usage.
Rejected Alternatives
None