...
0.8 Performance testing
Producer throughput
No. of Brokers = 1 / Replication Factor = 1 (Partition = 1)
Producer threads | comp | msg size | Acks batch batch |
| Thru Put Throughput (MB/s) | |||||||||||
1 | 0 | 1024 | -1 | 1 | 5.49 | |||||||||||
2 | 0 | 1024 | 0 | 1 | 9.38 | |||||||||||
5 | 0 | 1024 | -1 | 1 | 16.61 | |||||||||||
10 | 0 | 1024 | -1 | 1 | 19.54 | |||||||||||
1 | 0 | 1024 | -1 | 50 | 25.72 | |||||||||||
2 | 0 | 1024 | -1 | 50 | 39.25 | |||||||||||
5 | 0 | 1024 | -1 | 50 | 54.17 | |||||||||||
10 | 0 | 1024 | -1 | 50 | 56.71 | |||||||||||
|
|
|
|
| ||||||||||||
|
|
|
| Kafka Version | 0.7 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | ||||||
|
|
|
| Replication Factor | n/a | 1 | 2 | 2 | 3 | 3 | ||||||
|
|
|
| Remote / Local | Remote | Remote | Remote | Remote | Remote | Remote | ||||||
|
|
|
| Acks | n/a | -1 | -1 | 0 | -1 | 0 | ||||||
1 | 0 | 1024 | 1 |
| 29.57 | 1.78 | 0.58 | 1.19 | 0.53 | 0.94 | 1 | 0 | 1024 | -1 | 100 | 27.97 |
2 | 0 | 1024 | - 1 | 100 | 45.0535 | |||||||||||
5 | 0 | 1024 | -1 | 100 | 58.01 | |||||||||||
3.02 | 1.17 | 2.43 | 0.94 | 2.41 | ||||||||||||
5 10 | 0 | 1024 | - 1 | 100 | 59 58.8253 |
No. of Brokers = 3 / Replication Factor = 3 (Partitions = 1)
5.59 | 1.60 | 4.80 | 1.72 | 4.50 | ||||||||
10 | 0 | 1024 | 1 |
| 50.23 | 9.00 | 3.15 | 7.38 | 2.78 | 7.59 | ||
|
|
|
|
|
|
|
|
|
|
| ||
1 | 0 | 1024 | 50 |
| 49.15 | 12.22 | 7.48 | 11.95 | 7.08 | 10.76 | ||
2 | 0 | 1024 | 50 |
| 84.24 | 23.59 | 13.89 | 22.14 | 13.40 | 20.89 | ||
Producer threads | comp | msg size | Acks | batch | Thru Put (MB/s) | |||||||
1 | 0 | 1024 | -1 | 1 | 0.53 | |||||||
2 | 0 | 1024 | -1 | 1 | 0.94 | |||||||
5 | 0 | 1024 | -1 | 1 | 1.72 | |||||||
10 | 0 | 1024 | -1 | 1 | 2.78 | |||||||
1 | 0 | 1024 | -1 | 50 | 7.08 | |||||||
2 | 0 | 1024 | -1 | 50 | 13.40 | |||||||
5 | 0 | 1024 | -1 | 50 |
| 102.44 | 39.09 | 18.11 | 33.70 50 | 18.11 | 30.35 | |
10 | 0 | 1024 | -1 | 50 |
| 103.02 | 49.12 | 20.91 | 38.28 50 | 21.01 | 36.14 | |
|
|
|
|
|
|
|
|
|
|
| ||
1 | 0 | 1024 | -1 | 100 |
| 49.76 | 14.14 | 8.72 | 13.85 100 | 8.09 | 11.42 | |
2 | 0 | 1024 | -1 | 100 |
| 84.75 | 25.66 | 16.84 | 23.65 100 | 14.88 | 21.28 | |
5 | 0 | 1024 | -1 | 100 |
| 92.78 | 42.78 | 20.66 | 35.67 100 | 19.93 | 32.57 | |
10 | 0 | 1024 | 100 | -1 | 100.23 | 50.40 | 23.82 | 42.83 | 23.22 | 39.95 |