Page History

...

Table 1 shows the impact on producer performance in the context of 3 m5.marge large EC2 broker instances, with 1 KB-sized records and requested throughput of 240Mbps on a single topic. The table indicates that throughput with 3-way replication improves from 52Mbps to 101Mbps in going from 10 to 100 partitions, but then degrades beyond that. Also, the throughput with 1-way replication is better compared to that with 3-way replication. This is because of the number of replication Fetch requests that a broker receives increases with the number of partitions on the broker, and having 1-way replication means that the broker does not have to deal with Fetch requests. But even so, the performance is much worse with 10000 partitions than with 10 partitions.

Table 1: Producer performance test throughput (Mbps) on 3 m5.large brokersEC2 broker instances, with 1KB-sized records and requested throughput 240 Mbps on a single topic.

...