Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Integrate with Flink Sink API (FLIP-143)
  • Integrate with Flink new Source API (FLIP-27)
  • Build upon Flink New DynamicTableSink and DynamicTableSinkFactory interfaces (FLIP-95)
  • Sink streaming results with checkpointing enabled (at-least-once delivery semantics)

Proposed Changes

We propose to introduce dedicated Opensearch connectors (for 1.x and 2.x release lines) in Flink, based on existing Elasticsearch 7 connectors (https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/elasticsearch/).

...

The connectors are compatible with Opensearch 1.x and 2.x release lines.

Test Plan

The integration test cases along with end-2-end test suites have been implemented, on par with Elasticsearch connectors test coverage.

Rejected Alternatives

Keep using existing Elasticsearch to connect to Opensearch cluster would not work.