...

Flink ETL job consumes data from Source and produces result to Sink. Source creates relationship with Sink through Flink ETL job. Flink needs a mechanism for users to report these relationships to external systems, such as meta system Datahub [1], Atlas [2] and meta store we mentioned in FLIP-276 [3].

This FLIP aims We would like to introduce listener interfaces in Flink, users can implement them to report the meta data and lineage to external systems. The main information is as follows

...

4. Job execution status changed information, such as job status, exception.

This FLIP will focuses on customized meta data listener and customized job lineage listener will be discussed introduced in FLIP-314 [4]

Public Interfaces

...