THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Polling can be monitored with Consumer fetch metrics, e.g. fetch-latency-avg/max
| Info |
|---|
Predicates as implemented via PredicatedTransformation will be also measured. |
As metrics are recorded at a per-record basis, the implementation for this KIP will include the benchmark of metrics:
| Jira | ||||||
|---|---|---|---|---|---|---|
|
Public Interfaces
The following metrics would be added at the Task Level:
...
| Sensor / Recording Level | Attribute name | Description |
|---|---|---|
sink-record-latency INFO |
| The maximum latency of a record, measured by comparing the record timestamp with the system time (i.e. wallclock) when it has been received by the Sink task right after consumer poll and before conversions. |
| The average latency of a record, measured by comparing the record timestamp with the system time (i.e. wallclock) when it has been received by the Sink task right after consumer poll and before conversions. | |
convert-sink-record-time INFO |
| The average time taken by this task to convert sink records, including key, value, and headers conversion. |
| The maximum time taken by this task to convert sink records, including key, value, and headers conversion. | |
convert-sink-record-key-time DEBUG |
| The average time taken by this task to convert sink record keys. |
| The maximum time taken by this task to convert sink record keys. | |
convert-sink-record-value-time DEBUG |
| The average time taken by this task to convert sink record values. |
| The maximum time taken by this task to convert sink record values. | |
convert-sink-record-headers-time DEBUG |
| The average time taken by this task to convert sink record headers. |
| The maximum time taken by this task to convert sink record headers. | |
transform-chain-sink-record-time INFO |
| The average time taken by this task to apply all the transforms included in this task. |
| The maximum time taken by this task to apply all the transforms included in this task. |
...