Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Polling can be monitored with Consumer fetch metrics, e.g. fetch-latency-avg/max 


Predicates as implemented via PredicatedTransformation will be also measured.

Public Interfaces

The following metrics would be added at the Task Level:

...

kafka.connect:type=sink-task-transform-metrics,connector="{connector}",alias="{transform_alias}",task="{task}"

Sensor /  Recording LevelAttribute nameDescription

transform-sink-record-time (?)

DEBUG

  • transform-sink-record-time-avg-ms
The average time taken by this task to apply specific transform included in this task.
  • transform-sink-record-time-max-ms
The maximum time taken by this task to apply specific transform included in this task.


kafka.connect:type=source-task-transform-metrics,connector="{connector}",alias="{transform_alias}",task="{task}"

Sensor /  Recording LevelAttribute nameDescription

transform-source-record-time

DEBUG

  • transform-source-record-time-avg-ms
The average time taken by this task to apply specific transform included in this task.
  • transform-source-record-time-max-ms
The maximum time taken by this task to apply specific transform included in this task.


More granular metrics are recorded at DEBUG level to avoid performance impact.

...

Compatibility, Deprecation, and Migration Plan

ConnectConfig and TransformationChain users will have to migrate to the new interfaces. Though the updates APIs are used internally on Worker instantiations of Tasks.

Rejected Alternatives

If there are alternative ways of accomplishing the same thing, what were they? The purpose of this section is to motivate why the design is the way it is and not some other way.

...