Page History

...

Furthermore, based on community feedbacks, there is currently no demand for arbitrary window processing on DataStream. However, it is worth noting that the DataSet API already offers full window processing capabilities. Integrating this existing capability into DataStream would enhance its functionality and better meet the needs of users.

Full window processing is a little special. Its processing semantics are applicable to batch processing scenarios. This feature could be Therefore, we propose to only support full window processing on DataStream. This feature is designed to work only when RuntimeExecutionMode=BATCH and does not support checkpoint. If user specifies RuntimeExecutionMode=STREAMING, the job will be failed to submit. Without the requirement for checkpoint, the underlying implementation can no longer rely on state and avoid the aforementioned conflict issues.

Additionally, it is worth noting that the DataSet API already offers full window processing capabilities. Integrating this existing capability into DataStream would enhance its functionality and better meet the needs of users. Therefore, we propose to only support full window processing on DataStream.

The definition of PartitionWindowedStream

...