Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • We store full file path (not fileId). So if we create new data file (say f1-c10c2.parquet), then we add new metadata recordrow in metadata table for this file
  • Schema can get complex if there are lot of columns.
  • Schema is going to be different for different tables based on columns in the table

...