DUE TO SPAM, SIGN-UP IS DISABLED. Goto Selfserve wiki signup and request an account.
...
Following is throughput difference among 1, 5, 10 max.in.flight.requests.per.connection. The first table uses a server is in AWS us-east-1 and the a producer is in AWS ap-northeast-1.
| max.in.flight.requests.per.connection | throughput | avg latency | max latency | 50th latency | 95th latency | 99th latency | 99.9th latency |
|---|---|---|---|---|---|---|---|
| 1 | 19.623234 records/sec | 25093.64 ms | 49788.00 ms | 25193 ms | 47286 ms | 49341 ms | 49788 ms |
| 5 | 95.129376 records/sec | 5111.89 ms | 10096.00 ms | 5135 ms | 9644 ms | 10095 ms | 10096 ms |
| 10 (temporary change hard code value in producer and broker) | 183.083120 records/sec | 2558.52 ms | 5036.00 ms | 2528 ms | 4749 ms | 5034 ms | 5036 ms |
The second table uses server and producer via localhost. As the result, more in-flight requests still improve throughput in low latency environment.
./bin/kafka-producer-perf-test.sh --topic quickstart-events --num-records 10000000 --throughput 1000000000 --record-size 1000 --transactional-id thisistest --bootstrap-server 127.0.0.1:9092 --command-property max.in.flight.requests.per.connection=x
| max.in.flight.requests.per.connection | throughput | avg latency | max latency | 50th latency | 95th latency | 99th latency | 99.9th latency |
|---|---|---|---|---|---|---|---|
| 1 | 198562.408165 records/sec (189.36 MB/sec) | 126.01 ms | 464.00 ms | 147 ms | 171 ms | 260 ms | 430 ms |
| 5 | 285087.094107 records/sec (271.88 MB/sec) | 2.81 ms | 127.00 ms | 0 ms | 14 ms | 68 ms | 108 ms |
| 10 (temporary change hard code value in producer and broker) | 307238.540002 records/sec (293.01 MB/sec) | 2.14 ms | 76.00 ms | 0 ms | 8 ms | 45 ms | 73 ms |
Public Interfaces
Broker Configuration
...