Page History

Table of Contents

Current Pipeline

The current Flink writer pipeline is as follows:

...

1. Implements the current code base on #step1 and add a test framework to the hoodie-fink module, including the UTs and ITs
2. Refactoring the HoodieFlinkWriteClient to abstract out the indexing/bucketing work, in hoodie-spark, they are all sub-pipelines, but in flinkFlink, we should abstract it as Interface/Operator
3. Implements the code to #step2
4. Implements the code to #step3
5. Add a new index

...