Page History

...

• This script is used to load the proper datasets for the specified workloads. It loads all data via Hive except for parquet data which needs to be loaded via Impala. Most ddl commands are executed by Impala.
• Use -h options to see all usages.

• Examples

  Code Block

  # Load data of a specific workload (functional-query) with a specifit stategy (core) bin/load-data.py -e core -w functional-query # Load data only in the specific formats. bin/load-data.py -e core -w functional-query --table_formats=text/none,parquet/none,orc/def/block # Force reload (-f) data of specific tables in the specific formats bin/load-data.py -e core -w tpch -f --table_formats=parquet/none --table_names=lineitem # Load TPCDS text,parquet and orc tables in scale factor 30. bin/load-data.py -e core -w tpcds --scale_factor=30 --table_formats=text/none,parquet/none,orc/def/block

  
  

...