Status
Current state: ["Under Discussion"]
Discussion thread:
JIRA:
Released: 1.11.0
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
Motivation
Confluent Schema Registry provides a RESTful interface for developers to define standard schemas for their events, share them across the organization and safely evolve them in a way that is backward compatible and future proof. Schema Registry stores a versioned history of all schemas and allows the evolution of schemas according to the configured compatibility settings. It also provides a plugin to clients that handles schema storage and retrieval for messages that are sent in Avro format.
A Confluent Schema Registry Catalog make the Flink SQL table access extremely convenient, all need to config is a single schema registry URL, then all the Kafka topics registered in the schema registry service can be accessed in Flink SQL and table API. Here is a code snippet to illustrate how to access tables by registering such a catalog:
Code Block | ||||
---|---|---|---|---|
| ||||
StreamTableEnvironment tEnv = ...
ConfluentSchemaRegistryCatalog catalog = new ConfluentSchemaRegistryCatalog(
properties,
schemaRegistryURL,
"catalog1",
"db1");
tEnv.registerCatalog("catalog1", catalog);
// ---------- Consume stream from Kafka -------------------
String query = "SELECT\n" +
" id, amount\n" +
"FROM catalog1.db1.transactions1"; |