THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Batch Size | Old Format Overhead | New Format Overhead |
1 | 34*1 = 34 | 53 + 1*7 = 60 |
3 | 34*3 = 102 | 53 + 3*7 = 74 |
10 | 34*10 = 340 | 53 + 10*7 = 123 |
50 | 34*50 = 1700 | 53 + 50*7 = 403 |
100 | 34*100 = 3400 | 45 53 + 100*7 = 745753 |
Metrics
As part of this work, we would need to expose new metrics to make the system operable. These would include:
- Number of live PIDs (a proxy for the size of the PID->Sequence map)
- Current LSO per partition (useful to detect stuck consumers and lost commit/abort markers).
- Number of active transactionalIds (proxy for the memory consumed by the transaction coordinator).
...