THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Ideally we would repeat this scenario and script in broker failures (kills), server pauses (simulated), etc.
0.8 Performance testing
Producer throughput
No. of Brokers = 1 / Replication Factor = 1 (Partition = 1)
Producer threads | comp | msg size | Acks | batch | Thru Put (MB/s) |
1 | 0 | 1024 | -1 | 1 | 5.49 |
2 | 0 | 1024 | 0 | 1 | 9.38 |
5 | 0 | 1024 | -1 | 1 | 16.61 |
10 | 0 | 1024 | -1 | 1 | 19.54 |
1 | 0 | 1024 | -1 | 50 | 25.72 |
2 | 0 | 1024 | -1 | 50 | 39.25 |
5 | 0 | 1024 | -1 | 50 | 54.17 |
10 | 0 | 1024 | -1 | 50 | 56.71 |
1 | 0 | 1024 | -1 | 100 | 27.97 |
2 | 0 | 1024 | -1 | 100 | 45.05 |
5 | 0 | 1024 | -1 | 100 | 58.01 |
10 | 0 | 1024 | -1 | 100 | 59.82 |
No. of Brokers = 3 / Replication Factor = 3 (Partitions = 1)
Producer threads | comp | msg size | Acks | batch | Thru Put (MB/s) |
1 | 0 | 1024 | -1 | 1 | 0.53 |
2 | 0 | 1024 | -1 | 1 | 0.94 |
5 | 0 | 1024 | -1 | 1 | 1.72 |
10 | 0 | 1024 | -1 | 1 | 2.78 |
1 | 0 | 1024 | -1 | 50 | 7.08 |
2 | 0 | 1024 | -1 | 50 | 13.40 |
5 | 0 | 1024 | -1 | 50 | 18.11 |
10 | 0 | 1024 | -1 | 50 | 21.01 |
1 | 0 | 1024 | -1 | 100 | 8.09 |
2 | 0 | 1024 | -1 | 100 | 14.88 |
5 | 0 | 1024 | -1 | 100 | 19.93 |
10 | 0 | 1024 | -1 | 100 | 23.22 |