...
For example, we can see that according to the hash function provided by the Flink, the key group of key_0 is 64. However, it is forwarded to the downstream operator, who only takes responsibility for key groups from 0 to 63, but not including 64. The downstream operator would then try to extract and update the state of KeyGroup 64, which it doesn't take responsibility for. Therefore, a runtime error would be triggered.
In this FLIP, we would like to refactor this rein
Public Interfaces
Proposed Changes
...
- The key of a record could and only could appear in one split in the lifecycle of a job. The lifecycle of a job is not only executed in
- Pre-KeyedStream is saying that the external system has already partitioned the data stream w.r.t. the selected key.
...
Overall, the user has to provide the following mapping,
Record → Key → SplitID → KeyGroup
...