THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Discussion thread: here
JIRA: here
The proposal discussed in this KIP is implemented in this pull request.
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
Type | Name | Description |
---|---|---|
Record | record | The record which caused the exception (if available). |
Stage[] | stages | An ordered array of stages. |
int | index | A pointer to a stage in the array where the failure occurred. |
string | exception | The exception, and stacktrace for the failure (if available). |
int32 | attempt | Number of attempts made to correct the failure. |
string | task_id | The id of the task which where the failure occurred. |
int64 | time_of_error | The epoch time of failure. |
where Record contains the following fields encodes either the Sink or Source Record which caused the failure. It is the input to an operation which failed to evaluate.
Type | Name | Description |
---|---|---|
string | topic | the topic which this message was read from or will be written to. |
int32 | partition | the partition which this message was read from or will be written to. |
int64 | timestamp | the timestamp of the Kafka message. |
SchemaAndValue | key | the key of the message. |
SchemaAndValue | value | the value of the message. |
SchemaAndValue | headers | the headers of the message. |
int64 | offset | the offset of the message in the Kafka topic (available only in sink connectors). |
string | timestamp_type | the type of the timestamp. One of: NO_TIMESTAMP_TYPE, CREATE_TIME or LOG_APPEND_TIME (available only in sink connectors). |
map<string, string> | source_partition | information about the source partition from where this message was created from (available only in source connectors and contents are specific to the implementation). |
map<string, string> | source_offset | information about the source offset from where this message was created from (available only in source connectors and contents are specific to the implementation). |
...