Page History

...

Some caveats to be aware of: load moves the file, and this still has small files. Next draft will probably use 'alter' and create a new data to write dedupe'd data.

This solves 3 potential data ingestion problems – small files, duplicates, and bucketing data into date related groups.