Page History

...

Firstly, we can avoid the singleton task operator InstantGeneratorOperator by implementing an operator coordinator for the write operator, the coordinator always starts the checkpoint first, it starts a new commit on a new checkpointing

Image Modified

Work Flow

The write function would firstly buffer the data as a batch of HoodieRecords,

...