Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Minor edits and links fixed

...

The HiveServer2 WebUI SPNEGO service principal. The special string _HOST will be replaced automatically with the value of hive.server2.webui.host or the correct host name.

Spark

Apache Spark was added in Hive 1.1.0 (HIVE-7292 and the merge-to-trunk JIRA's HIVE-9257, 9352, 9448). For information see the design document Hive on Spark and Hive on Spark: Getting Started.

...

hive.spark.dynamic.partition.pruning
  • Default Value: false
  • Added In: Hive 1Hive 1.3.0 with 0 with HIVE-9152

When true, this turns on dynamic partition pruning for the Spark engine, so that joins on partition keys will be processed by writing to a temporary HDFS file, and read later for removing unnecessary partitions.

hive.spark.dynamic.partition.pruning.max.data.size
  • Default Value: 100MB
  • Added In: Hive 1Hive 1.3.0 with 0 with HIVE-9152

The maximum data size for the dimension table that generates partition pruning information. If reaches this limit, the optimization will be turned off.

hive.spark.exec.inplace.progress
  • Default Value: true
  • Added In: Hive 2.2.0 with HIVE-15039

Updates spark Spark job execution progress in-place in the terminal.

...

  • Default Value: hive.spark.client.rpc.server.address, localhost if unavailable.
  • Added In: Hive 2Hive 2.1.0 with 0 with HIVE-12568

The server address of HiverServer2 host to be used for communication between Hive client and remote Spark driver.

...