Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

0.8 Performance testing

Producer throughput

No. of Brokers = 1 / Replication Factor = 1 (Partition = 1)

Producer threads

comp

msg size

Acks batch batch

 

Thru Put Throughput (MB/s)

1

0

1024

-1

1

5.49

2

0

1024

0

1

9.38

5

0

1024

-1

1

16.61

10

0

1024

-1

1

19.54

1

0

1024

-1

50

25.72

2

0

1024

-1

50

39.25

5

0

1024

-1

50

54.17

10

0

1024

-1

50

56.71

 

 

 

 

 

 

 

 

 

Kafka Version

0.7

0.8

0.8

0.8

0.8

0.8

 

 

 

 

Replication Factor

n/a

1

2

2

3

3

 

 

 

 

Remote / Local

Remote

Remote

Remote

Remote

Remote

Remote

 

 

 

 

Acks

n/a

-1

-1

0

-1

0

1

0

1024

1

 

29.57

1.78

0.58

1.19

0.53

0.94

1

0

1024

-1

100

27.97

2

0

1024

- 1

100 

45.0535

5

0

1024

-1

100

58.01

3.02

1.17

2.43

0.94

2.41

5 10

0

1024

- 1

100 

59 58.8253

No. of Brokers = 3 / Replication Factor = 3 (Partitions = 1)

5.59

1.60

4.80

1.72

4.50

10

0

1024

1

 

50.23

9.00

3.15

7.38

2.78

7.59

 

 

 

 

 

 

 

 

 

 

 

1

0

1024

50

 

49.15

12.22

7.48

11.95

7.08

10.76

2

0

1024

50

 

84.24

23.59

13.89

22.14

13.40

20.89

Producer threads

comp

msg size

Acks

batch

Thru Put (MB/s)

1

0

1024

-1

1

0.53

2

0

1024

-1

1

0.94

5

0

1024

-1

1

1.72

10

0

1024

-1

1

2.78

1

0

1024

-1

50

7.08

2

0

1024

-1

50

13.40

5

0

1024

-1

50

 

102.44

39.09

18.11

33.70 50

18.11

30.35

10

0

1024

-1

50

 

103.02

49.12

20.91

38.28 50

21.01

36.14

 

 

 

 

 

 

 

 

 

 

 

1

0

1024

-1

100

 

49.76

14.14

8.72

13.85 100

8.09

11.42

2

0

1024

-1

100

 

84.75

25.66

16.84

23.65 100

14.88

21.28

5

0

1024

-1

100

 

92.78

42.78

20.66

35.67 100

19.93

32.57

10

0

1024

100

-1 

100.23

50.40

23.82

42.83

23.22

39.95