Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

In SQL layer, the watermark is closely related to each source table, so we plan to extend these features in the dynamic table options and 'OPTIONS' hint.  If the user has configured these options both in the dynamic table options and in the 'OPTIONS' hint, then the options in the 'OPTIONS' hint are preferred. If the user uses 'OPTIONS' hint for the same source table in multiple places, the first hint will be used.

We provide a poc, you can check the poc[1] to look up the code details.

1. Configurable watermark emit strategy

...

We should be cautious about adding SQL syntax, WATERMARK_PARAMS is also SQL syntax to some extent.


Reference

[1] https://github.com/yuchengxin/flink/commits/yuankui/watermark_params

[2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-66%3A+Support+Time+Attribute+in+SQL+DDL

[23] https://cwiki.apache.org/confluence/display/FLINK/FLIP-182%3A+Support+watermark+alignment+of+FLIP-27+Sources 

[34] https://cwiki.apache.org/confluence/display/FLINK/FLIP-217%3A+Support+watermark+alignment+of+source+splits 

...