THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| Page properties | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
FLIP-176: Unified Iteration to Support Algorithms has introduced a unified iteration library in the Flink -ml ML repository. This library addresses all the issues present in the Iteration API of DataStream and could provide solution for all the iteration use-cases. However, maintaining two separate implementations of iteration in both the Flink repository and the Flink -ml ML repository would introduce unnecessary complexity and make it difficult to maintain the Iteration API.
We propose deprecating the Iteration API of DataStream and removing it completely before Flink 2.0. If other modules in the next major version. In the future, if other modules in the Flink repository require the use of the Iteration API in the future, we can consider extracting all Iteration implementations from the flink-ml Flink ML repository into an independent module.
Public Interfaces
Modify the annotation of the following classes and methods to @Deprecated.
| Class / Method | Annotation |
|---|---|
| org.apache.flink.streaming.api.datastream.DataStream#iterate() | PublicEvolving |
org.apache.flink.streaming.api.datastream.DataStream#iterate(long maxWaitTimeMillis) | |
| org.apache.flink.streaming.api.datastream.IterativeStream | |
| org.apache.flink.streaming.api.datastream.IterativeStream.ConnectedIterativeStreams | Public |
Proposed Changes
We propose deprecating the classes/methods mentioned above and subsequently removing the documentation about the Iteration of DataStream from the Flink website.
Compatibility, Deprecation, and Migration Plan
N.AThe Iteration API in DataStream is planned be deprecated in Flink 1.19 and then finally removed in Flink 2.0. For the users that rely on the Iteration API in DataStream, they will have to migrate to Flink ML.
Test Plan
N.A.
Rejected Alternatives
...