Page History

...

name	type	description
name	String	catalog.database.tableName
log.system	String	the log system
log.kafka.bootstrap.servers	Map	Kafka brokers
log.retention	Duration	how long changes log will be kept
file.path	String	File path
log.kafka.topic	String	topic of Kafka
file.format	String	format for file
bucket	Integer	bucket number
change-tracking	Boolean	does this table tracking changes

...

Key	Default	Type	Description
table-storage.log.system	kafka	String	Log system. Now only Kafka in the MVP.
table-storage.log.kafka.bootstrap.servers	(none)	String	Kafka brokers. eg: localhost:9092
table-storage.log.retention	(none)	Duration	It means how long changes log will be kept. The default value is from the log system cluster.
table-storage.log.consistency	transactional	String	Specifies the log consistency mode for table. transactional: only the data after the checkpoint can be seen by readers, the latency depends on checkpoint interval eventual: Immediate data visibility, you may see some intermediate states, but eventually the right results will be produced, only works in table with primary key
table-storage.log.changelog-mode	auto	String	Specifies the log changelog mode for table. auto: upsert for table with primary key, all for table without primary key. upsert: the log system does not store the UPDATE_BEFORE changes, the log consumed job will automatically add the normalized node, relying on the state to generate the required update_before. all: the log system stores all changes including UPDATE_BEFORE
table-storage.log.key.format	json	String	Specifies the key message format of log system with primary key.
table-storage.log.format	debezium-json	String	Specifies the message format of log system.
table-storage.file.path	(none)	String	Root file path.
table-storage.file.format	parquet	String	Format name for file.
table-storage.bucket	1	Integer	Bucket number for file and Partition number for Kafka.

...

Page tree