THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
To replace the GlobalCommitter in existing sinks we offer a utility that simulates the GlobalCommitter with a post committing topology.
Connector Implementations
We envision the implementation of certain connectors can be done with the following interfaces.
Connector | Sink | StatefulSink | TwoPhaseCommittingSink | WithPreWriteTopology | WithPreCommitTopology | WithPostCommitTopology |
---|---|---|---|---|---|---|
Kafka | ||||||
File | ||||||
Elasticsearch | ||||||
Hive | ( | |||||
Iceberg |
Limitations
Since the DataStream class is not part of the flink-core module all advanced Sink interfaces are part of the flink-streaming-java. We mitigate the problem by adding enough documentation i.e. in the doc strings that users are aware of the split.
...