Versions Compared

Old Version 64

changes.mady.by.user Xuannan Su

Saved on

compared with

New Version 65

changes.mady.by.user Dong Lin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Override getOperatorAttributes to return IsInternalSorterSupported = true.
  • Override processRecordAttributes() API to adjust its behavior based on the input's isBacklog status.
    • The operator can buffer and sort input records when any input has isBacklog=true AND execution.checkpointing.interval-during-backlog=0.
    • Once all inputs' status has switched to isBacklog=false, it processes the buffered records, emits results, and starts to work in the stream execution mode.

...


Analysis of APIs affected by this FLIP


1) After the proposed changes, the following DataStream API should have similar performance as batch mode during backlog processing.

...