Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The assumption is that B has few rows with keys which are skewed in A. So these rows can be loaded into the memory.

Hive Enhancements

Hive needs to be extended to support the following:

    • create table <T> (schema) skewed by (keys) with skew (values);
    • alter table <T> (schema) skewed by (keys) with skew (values);

e.g.,

...

The skew data will be obtained from list bucketing (https://cwiki.apache.org/Hive/listbucketing.htmlImage Added). There are no additions to the Hive grammar.