Page History

...

• Snapshot queries as the latest state of a dataset. The default scan mode is set to LATEST.

  • Excerpt Include
    query scan mode snapshot query scan mode snapshot

• Incremental queries provides incremental changes between time (t1,t2], can control this by using a scan mode called INCREMENTAL

  • Excerpt Include
    query scan model incremental query scan model incremental

All of these view are exposed by intercepting the planning stage through the HoodieInputFormat. Before we dive further into incremental changes, I want to bring to everyone's attention what incremental changes from Hudi really mean. For eg, if you have a log table (say log events from Kafka), incremental_pull (t1, t2] would provide you all the records that were ingested between those instants.

...