...
0.8 Performance testing
Producer throughput
...
Producer threads
...
comp
...
msg size
...
batch
...
Message size : ~1K Production Data
Throughput in
...
MB/s
...
|
| Kafka Version | 0.7 |
|
|
| 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 |
| 0.8 | 0.8 |
|
|
|
| Kafka Version | 0.7 | 0.8 | 0.8 | 0.8 | 0.8 | 0.8 |
| 0.8 | 0.8 | |||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
| Replication Factor | n/a |
| 1 | 1 | 1 2 2 | 1 | 3 1 3 | 1 | 1 | 1 | 1 |
| Remote / Local 2 Remote | 2 | Remote 2 Remote | 2 | Remote 2 Remote | 2 | Remote 2 | 2 | 2 | ||||||||||||||
|
| Acks | n/a |
| -1 | 1 | 0 | -1 | 1 | 0 | -1 | 1 | 0 |
| -1 | 1 | 0 | -1 | 1 | 0 | -1 | 1 | 0 | ||||||||||||||
|
| Compression | Uncomp |
| Uncomp | Uncomp | Uncomp | Gzip | Gzip | Gzip | Snappy | Snappy | Snappy |
| Uncomp | Uncomp | Uncomp | Gzip | Gzip | Gzip | Snappy | Snappy | Snappy | ||||||||||||||
Producer threads | Batch size |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| ||||||||||||||
1 1024 | 1 |
| 29.57 |
| 1.66 | 1.69 | 19.48 | 0.94 | 0.97 | 3.51 | 1.53 | 1.78 46 | 11.40 |
| 0.58 56 | 1.19 61 | 23.52 | 0.53 35 | 0.94 91 | 2 3.70 | 0.56 | 1.45 | 10.83 | ||||||||||||||
2 1024 | 1 |
| 45.35 |
| 3.02 .31 | 3.11 | 23.82 | 1.80 | 1.17 72 | 3.87 | 2.30 | 2.43 | 11.65 |
| 1.27 0.94 | 2.41 79 | 20.59 | 0.66 | 1.39 | 3.86 | 1.07 | 2.19 | 11.39 | ||||||||||||||
5 | 5 | 0 | 1024 | 1 |
| 58.53 |
| 5.24 | 5.49 | 20.26 | 2.59 | 2.86 | 3.35 | 4.02 | 4.48 | 13.36 |
| 1.60 79 | 4.80 .76 | 21.29 | 1.16 | 2.49 | 3.06 | 1.72 93 | 4 3.50 98 | 10.49 | |||||||||||
0 10 | 1024 | 1 |
| 50.23 | 9.00 | 3.15 | 7.38 | 2.78 |
| 8.20 | 8.59 | 19.65 | 3.17 | 2.77 | 2.87 | 7.35 | 7.39 | 10.51 |
| 2.90 | 7.97 | 19.44 | 1.85 | 2.68 | 3.05 | 3.27 | 7.24 | 12.01 | |||||||||
|
|
|
|
|
|
|
|
| 7.59 |
|
|
|
|
|
|
|
|
|
|
| 1 | 0 | |||||||||||||||
1024 1 | 50 |
| 49.15 | 12.22 | 7.48 | 11.95 | 7.08 | 10.76 |
| 17.95 | 18.88 | 77.43 | 7.93 | 7.66 | 26.88 | 15.42 | 15.44 | 62.33 |
| 10.57 | 15.76 | 57.85 | 4.79 | 7.50 | 28.61 | 10.31 | 13.98 | 66.15 | |||||||||
2 | 2 | 0 | 1024 | 50 |
| 84.24 | 23.59 | 13.89 | 22.14 | 13.40 | 20.89 |
| 34.94 | 33.41 | 82.67 | 14.88 | 15.25 | 30.13 | 29.77 | 26.47 | 71.18 |
| 17.26 | 27.26 | 78.50 | 9.53 | 14.29 | 30.11 | 16.82 | 26.10 | 90.98 | ||||||
5 | 5 | 0 | 1024 | 50 |
| 102.44 | 39.09 | 18.11 | 33.70 | 18.11 | 30.35 |
| 64.38 | 62.82 | 89.66 | 17.56 | 18.23 | 19.47 | 57.54 | 58.58 | 71.71 |
| 26.02 | 47.69 | 86.62 | 12.48 | 17.39 | 31.54 | 33.13 | 54.18 | 74.96 | ||||||
10 | 10 | 0 | 1024 | 50 |
| 103.02 | 49.12 | 20.91 | 38.28 | 21.01 |
| 61.06 | 64.57 | 86.48 | 18.45 | 17.24 | 20.38 | 59.59 | 58.44 | 69.34 |
| 28.08 | 59.80 | 91.62 | 18.68 | 17.90 | 20.02 | 35.62 | 62.03 | 72.02 | |||||||
|
|
|
|
|
|
|
|
| 36.14 |
|
|
|
|
|
|
|
|
|
|
| 1 | 0 | |||||||||||||||
1024 1 | 100 |
| 49.76 |
| 23.69 | 23.56 | 75.71 | 8.93 | 9.04 | 28.69 | 21.73 | 21.79 | 70.55 |
| 12.69 | 21.61 | 52.12 | 5.86 | 8.85 | 27.49 | 13.48 | 21.04 | 66.70 | ||||||||||||||
2 | 14.14 | 8.72 | 13.85 | 8.09 | 11.42 | 2 | 0 | 1024 | 100 |
| 84.75 | 25.66 | 16.84 | 23.65 | 14.88 | 21.28 |
| 42.85 | 40.46 | 84.72 | 18.48 | 16.90 | 31.69 | 42.61 | 38.07 | 85.78 |
| 22.54 | 35.81 | 74.53 | 11.16 | 17.18 | 35.86 | 25.63 | 37.95 | 106.99 | |
5 | 5 | 0 | 1024 | 100 |
| 92.78 | 42.78 | 20.66 | 35.67 | 19.93 | 32.57 |
| 67.65 | 67.89 | 87.24 | 21.93 | 19.78 | 21.40 | 67.22 | 65.94 | 87.98 |
| 26.93 | 57.77 | 86.46 | 15.20 | 18.92 | 25.35 | 37.40 | 75.18 | 83.91 | ||||||
10 | 100 |
| 100.23 |
| 67.53 | 68.40 | 87.99 | 19.82 | 20.80 | 21.38 | 69.64 | 68.49 | 81.88 |
| 31.36 | 63.19 | 88.68 | 17.39 | 18.96 | 21.56 | 43.26 | 72.14 | 84.89 | 10 | 0 | 1024 | 100 |
| 100.23 | 50.40 | 23.82 | 42.83 | 23.22 | 39.95 |