THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Definition
Type that determines how a commit will be stored and handled relative to its application to the target dataset.
#todo verify
Following table summarizes the trade-offs between these two storage types
Trade-off | Copy On Write (COW) | Merge On Read (MOR) |
---|---|---|
Data Latency | Higher | Lower |
Update cost (I/O) | Higher (rewrite entire dataset parquet) | Lower (append to `delta log`) |
Parquet File Size | Smaller (high update(I/0) cost) | Larger (low update cost) |
Write Amplification | Higher | Lower (depending on compaction strategy to the dataset parquet) |