Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Excerpt Include
    read optimized view
    read optimized view
  • Excerpt Include
    incremental view
     : Queries on this view only see new data written to the dataset, since a given commit/compaction. This view effectively provides change streams to enable incremental data pipelines.realtime view : Queries on this view see the latest snapshot of dataset as of a given delta commit action. This view provides near-real time datasets (few mins) by merging the base and delta files of the latest file slice on-the-fly.
    incremental view
    excerpt in
  • Excerpt Include
    realtime view
    realtime view

Following table summarizes the trade-offs between the different views query/view types.

Trade-offReadOptimizedRealTime
Data LatencyHigherLower
Query LatencyLower (raw columnar performance)Higher (merge columnar + row based delta)

...

Related concepts

  1. timeline instant
  2. dataset
  3. commit
  4. storage type

...