...
- Integrate with Flink Sink API (FLIP-143)
- Integrate with Flink new Source API (FLIP-27)
- Build upon Flink New DynamicTableSink and DynamicTableSinkFactory interfaces (FLIP-95)
- Sink streaming results with checkpointing enabled (at-least-once delivery semantics)
Proposed Changes
We propose to introduce dedicated Opensearch connectors (for 1.x and 2.x release lines) in Flink, based on existing Elasticsearch 7 connectors (https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/elasticsearch/).
...
The connectors are compatible with Opensearch 1.x and 2.x release lines.
Test Plan
The integration test cases along with end-2-end test suites have been implemented, on par with Elasticsearch connectors test coverage.
Rejected Alternatives
Keep using existing Elasticsearch to connect to Opensearch cluster would not work.