Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

A typical problem with the plan is that the scan is not parallel enough. For Trafodion tables, you can address this issue with the default attribute, PARALLEL_NUM_ESPS. Using this attribute, a Trafodion scan can be parallelized to as many number of SALT partitions that are defined for the table. For Hive source tables, the default attributes, HIVE_NUM_ESPS_PER_DATANODE and HIVE_MIN_BYTES_PER_ESP_PARTITION, can be used to adjust the degree of parallelism.

Cleaning up after a failed LOAD

When a LOAD statement fails it will likely leave some files behind in the /bulkload directory. These files are the HFiles that have been created before the failure occurred. These HFiles have not been moved in HBase control and are not part of the target table yet. They should be removed. If they are not taking space, the files can left alone. The next LOAD statement into the same target table will cleanup these files, before starting is actual load operation. Alternatively these commands can be used from any SQL interface to remove these files. 

control query default COMP_BOOL_226 'ON' ;
LOAD CLEANUP FOR TABLE <target-table> ;

This command should complete quickly.

Update statistics times out during sampling

...