Page History

...

That is to replace the coordinator with instance generator and commit sink just like the original pipeline.

Image Added

Implementation Plan

1. Implements the current code base on #step1 and add a test framework to the hoodie-fink module, including the UTs and ITs
2. Refactoring the HoodieFlinkWriteClient to abstract out the indexing/bucketing work, in hoodie-spark, they are all sub-pipelines, but in Flink, we should abstract it as Interface/Operator
3. Implements the code to #step2
4. Implements the code to #step3
5. Add a new index
6. Add compatible pipeline

Each step would have a separate JIRA issue.