Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Kafka Cluster: n-broker setup (do we need more than 1?)

  • Producer: Pre-configured to produce varying sizes and volumes of messages

  • Consumer: The new Kafka consumer under testAsync Consumer and the current KafkaConsumer implementation

Consumption Rate

  1. Varying Message Sizes: Measure the rate of message consumption across different message sizes.

    • Metrics: Throughput (messages/sec), Latency

    • Tools: Kafka built-in monitoring, custom logging

  2. Varying Message Numbers: Measure how well the consumer handles varying amounts of messages.

    • Metrics: Throughput, Backlog drain time

    • Tools: Kafka monitoring, custom loggingCPU Throttling

...