Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Add SupportsTimeTravel source ability  ability

SupportTimeTravel Source Ability will be applied in the optimization phase, but Time Travel not only requires obtaining data at the corresponding time point, but also requires the corresponding Schema at that time point. Therefore, TimeTravel is not only an ability of Source, but also needs support from Catalog.   


Here is the brief implement plan. Add a new source ability interface. Different connectors can implement this interfaces to support time travel.

1. Add the Source Ability interface to support TimeTravel systems in implementing TimeTravel capabilities.
2. Add corresponding table optimization rules so that during LogicalPlan optimization, the Snapshot interval can be pushed up to the ScanTableSource.
3. To avoid conflicts with Temporal Join, we should apply TimeTravel transformation rules before apply the Temporal Join transformation rules.

...