Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For example, we can see that according to the hash function provided by the Flink, the key group of key_0 is 64. However, it is forwarded to the downstream operator, who only takes responsibility for key groups from 0 to 63, but not including 64. The downstream operator would then try to extract and update the state of KeyGroup 64, which it doesn't take responsibility for. Therefore, a runtime error would be triggered.

In this FLIP, we would like to refactor this rein

Public Interfaces


Proposed Changes

...

  • The key of a record could and only could appear in one split in the lifecycle of a job. The lifecycle of a job is not only executed in  
  • Pre-KeyedStream is saying that the external system has already partitioned the data stream w.r.t. the selected key.

...

Overall, the user has to provide the following mapping,

                                                        Record → Key → SplitID → KeyGroup

...