Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Metric/Attribute NameDescription
source-record-poll-rateThe average per-second number of records produced/polled (before transformation) by this task belonging to the named source connector in this worker. This is before transformations are applied
source-record-poll-countThe number of records produced/polled (before transformation) by this task belonging to the named source connector in this worker, since the task was last restarted.
source-record-write-rateThe average per-second number of records output from the transformations and written to Kafka for this task belonging to the named source connector in this worker. This is after transformations are applied and excludes any records filtered out by the transformations.
source-record-write-countThe number of records output from the transformations and written to Kafka for this task belonging to the named source connector in this worker, since the task was last restarted.

 

Sink Task Metrics

MBean namekafka.connect:type=sink-task-metrics,connector=([-.\w]+),task=([\d]+)

...

Kafka for
Metric/Attribute NameDescription
sink-record-read-rateThe average per-second number of records read from Kafka (before transformations are applied) for this task belonging to the named sink connector in this worker.
sink-record-read-countThe number of records read from Kafka ( This is before transformations are applied) for this task belonging to the named sink connector in this worker, since the task was last restarted.
sink-record-send-rateThe average per-second numbrer of records output from the transformations and sent to this task belonging to the named sink connector in this worker. This is after transformations are applied and excludes any records filtered out by the transformations.
sink-record-send-countThe numbrer of records output from the transformations and sent to this task belonging to the named sink connector in this worker, since the task was last restarted.
sink-record-lag-maxThe maximum lag in terms of number of records behind the consumer the offset commits are for any topic partitions.
partition-countThe number of topic partitions assigned to this task belonging to the named sink connector in this worker.
offset-commit-seq-noThe current sequence number for offset commits
offset-commit-completion-rateThe average per-second number of offset commit completions that were completed successfully
offset-commit-completion-skip-rateThe average per-second number of offset commit completions that were received too late and skipped/ignored
flush-max-timeThe maximum time taken by this sink task to pre-commit/flush
flush-99p-timeThe 99th percentile time spent by this sink task to pre-commit/flush
flush-95p-timeThe 95th percentile time spent by this sink task to pre-commit/flush
flush-90p-timeThe 90th percentile time spent by this sink task to pre-commit/flush
flush-75p-timeThe 75th percentile time spent by this sink task to pre-commit/flush
flush-50p-timeThe 50th percentile (average) time spent by this sink task to pre-commit/flush

...