...
Key | Default | Type | Description |
table-storage.log.system | kafka | String | Log system. Now only Kafka in the MVP. |
table-storage.log.kafka.bootstrap.servers | (none) | Map | Kafka brokers. eg: localhost:9092 |
table-storage.log.retention | (none) | Duration | It means how long changes log will be kept. The default value is from the log system cluster. |
table-storage.log.scan | full | String | Specifies the scan startup mode for log consumer.
|
table-storage.log.consistency | transactional | String | Specifies the log consistency mode for table.
|
table-storage.log.changelog-mode | upsert | String | Specifies the log changelog mode for table with primary key.
|
table-storage.log.pk.key-format | json | String | Specifies the key message format of log system with primary key. |
table-storage.log.format | debezium-json | String | Specifies the message format of log system. |
table-storage.file.path | (none) | String | Root file path. |
table-storage.file.format | parquet | String | Format name for file. |
table-storage.bucket | 1 | Integer | Bucket number for file and Partition number for Kafka. |
table-storage.change-tracking | true | Boolean | If users do not need to consume changes from the table, they can disable Change Tracking. This can reduce resource consumption. |
...
- Key:
- Without primary key: key is null.
- With primary key: key is json format by default. This is controlled by 'log.pk.key-format'.
- Value: Use debezium-json to storerecord with or without declaration primary key by default. This is controlled by 'log.format'.
...