...
Kafka Cluster: n-broker setup (do we need more than 1?)
Producer: Pre-configured to produce varying sizes and volumes of messages
Consumer: The new Kafka consumer under testAsync Consumer and the current KafkaConsumer implementation
Consumption Rate
Varying Message Sizes: Measure the rate of message consumption across different message sizes.
Metrics: Throughput (messages/sec), Latency
Tools: Kafka built-in monitoring, custom logging
Varying Message Numbers: Measure how well the consumer handles varying amounts of messages.
Metrics: Throughput, Backlog drain time
Tools: Kafka monitoring, custom loggingCPU Throttling
...