Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

TypeNameDescription
RecordrecordThe record which caused the exception (if available).
Stage[] stagesAn ordered array of stages.
intindexA pointer to a stage in the array where the failure occurred.
stringexceptionThe exception, and stacktrace for the failure (if available).
int32attemptNumber of attempts made to correct the failure.
stringtask_idThe id of the task which where the failure occurred.
int64time_of_errorThe epoch time of failure.

where Record contains the following fields encodes either the Sink or Source Record which caused the failure. It is the input to an operation which failed to evaluate. 

TypeNameDescription
stringtopicthe topic which this message was read from or will be written to.
int32partitionthe partition which this message was read from or will be written to.
int64 timestampthe timestamp of the Kafka message.
SchemaAndValuekeythe key of the message.
SchemaAndValuevaluethe value of the message.
SchemaAndValueheadersthe headers of the message.
int64offsetthe offset of the message in the Kafka topic (available only in sink connectors).
stringtimestamp_typethe type of the timestamp. One of: NO_TIMESTAMP_TYPE, CREATE_TIME or LOG_APPEND_TIME (available only in sink connectors).
map<string, string>source_partitioninformation about the source partition from where this message was created from (available only in source connectors and contents are specific to the implementation).
map<string, string>source_offsetinformation about the source offset from where this message was created from (available only in source connectors and contents are specific to the implementation).

...