Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This document proposes the introduction of APIs that allow source operators (e.g., HybridSource, MySQL CDC Source) to send watermarks to downstream operators, indicating that the watermark should start increasing according to the system time. In addition to supporting processing-time temporal joins, this FLIP provides the fundation to simplifies DataStream APIs such as KeyedStream#window(...), such that users would no longer need to explicitly differentiate between TumblingEventTimeWindows and TumblingProcessingTimeWindows, leading to a more intuitive experience.

This document proposes the introduction of APIs that enable source operators (e.g., HybridSource, MySQL CDC Source) to send watermarks to downstream operators, signaling the start of increasing watermarks based on the system time. Apart from supporting processing-time temporal joins, this FLIP lays the groundwork for simplifying DataStream APIs, including KeyedStream#window(...), so that users would no longer be required to explicitly distinguish between TumblingEventTimeWindows and TumblingProcessingTimeWindows, resulting in a more intuitive user experience.

Terminology and Background

...

And we can remove TemporalProcessTimeJoinOperator because its functionality is covered by  TemporalRowTimeJoinOperator.

...

.


5) Update WatermarkToDataOutput to handle Watermark#useProcessingTime.

...