Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: move two properties into Indexing section; add versions for indexing properties and sort by version & jira

...

  • Default Value: false
  • Added In: Hive 0.8.0

Whether to enable automatic use of indexes.

hive.optimize.index.groupby
  • Default Value: false
  • Added In:

Whether to enable optimization of group-by queries using Aggregate Note:  See Indexing for more configuration properties related to Hive indexes.

hive.optimize.ppd

...

Allow JDO query pushdown for integral partition columns in metastore. Off by default. This improves metastore performance for integral columns, especially if there's a large number of partitions. However, it doesn't work correctly with integral values that are not normalized (e.g. have leading zeroes, like 0012). If metastore direct SQL is enabled and works, this optimization is also irrelevant.

Indexing

Indexing was added in Hive 0.7.0 with HIVE-417, and bitmap indexing was added in Hive 0.8.0 with HIVE-1803.  For more information see Indexing.

hive.index.compact.file.ignore.hdfs
  • Default Value: false
  • Added In:

...

When true the HDFS location stored in the index file will be ignored at runtime. If the data got moved or the name of the cluster got changed, the index data should still be usable.

hive.optimize.index.filter

...

  • Default Value:

...

Whether to enable automatic use of indexes.

hive.optimize.index.filter.compact.minsize
  • Default Value: 5368709120
  • Added In: Hive 0.8.0 with HIVE-1644

Minimum size (in bytes) of the inputs on which a compact index is automatically used.

...

  • Default Value: -1
  • Added In: Hive 0.8.0 with HIVE-1644

Maximum size (in bytes) of the inputs on which a compact index is automatically used. A negative number is equivalent to infinity.

...

  • Default Value: 10737418240
  • Added In: Hive 0.8.0 with HIVE-2096

The maximum number of bytes that a query using the compact index can read. Negative value is equivalent to infinity.

...

  • Default Value: 10000000
  • Added In: Hive 0.8.0 with HIVE-2096

The maximum number of index entries to read during a query that uses the compact index. Negative value is equivalent to infinity.

hive.index.compact.binary.search
  • Default Value: true
  • Added In:

Whether or not to use a binary search to find the entries in an index table that match the filter, where possible.

hive.exec.concatenate.check.index
  • Default Value: true
  • Added In: Hive 0.8.0 with HIVE-2125

If this sets to true, Hive will throw error when doing ALTER TABLE tbl_name [partSpec] CONCATENATE on a table/partition that has indexes on it. The reason the user want to set this to true is because it can help user to avoid handling all index drop, recreation, rebuild work. This is very helpful for tables with thousands of partitions.

hive.optimize.index.groupby
  • Default Value: false
  • Added In: Hive 0.8.1 with HIVE-1694
hive.index.compact.binary.search
  • Default Value: true
  • Added In: Hive 0.8.1 with HIVE-2535

Whether or not to use a binary search to find the entries in an index table that match the filter, where possible.

Statistics

See Statistics in Hive for information about how to collect and use Hive table statistics. 

...