Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Definition

An item in the `Hudi` ingestion processing timeline

Design details

At its core, Hudi maintains a timeline of all actions performed on the def~table at different instants of time that helps provide instantaneous views of the def~table, while also efficiently supporting retrieval of data in the order of arrival. A Hudi `timeline instant` consists of the following components

Design decisions

  1. Hudi guarantees that the actions performed on the timeline are atomic & timeline consistent based on the instant time.

...

Excerpt Include
def~instant-state
def~instant-state
nopaneltrue

Design decisions

  1. #todo

Related concepts

  1. def~table
  2. instant state
  3. def~instant-action-type
  4. def~instant-time
  5. def~commit
  6. file format

Status (draft)