Page History

...

After collecting more feedback we came up with the following design which incorporates the design of a Sink V2. Over the last few releases, we learned from our users that the abstraction of having a writer and a committer to implement a two-phase commit is very helpful but the GlobalCommitter in its current design cannot fulfill all necessary duties. Unfortunately, there is not an easy way to replace/remove the GlobalCommitter from the existing interfaces without breaking already built sinks due to the typed parameters of the interface. Therefore we propose Sink V2 that subsumes the current Sink interface and offers the same functionality.

...