...

Implementation Plan

• POC branch: https://github.com/JingsongLi/flink/tree/table_storage_formal 
• Implement in dev branch, the code will not enter the master branch for the time being
• Implement FileStore
  • Abstract Format: support ORC and Parquet
  • Implement LSM: MemStore and Compaction
  • Implement Snapshot and Manifest: Version control
• Implement LogStore
  • Auto create Kafka Topic
  • Integrate CDC Format and Upsert Kafka
• Integrate Flink
  • TableFactory: DynamicSource and DynamicSink
  • Integrate to Catalog
• Extended DMLs