Page History

...

Apache Spark was added in Hive 1.1.0 (HIVE-7292 and the merge-to-trunk JIRA's HIVE-9257, 9352, 9448).    For For information see the design document Hive on Spark and Hive on Spark: Getting Started. 

hive.spark.job.monitor.timeout

• Default Value: 60 seconds
• Added In: Hive 1.1.0 with HIVE-9337

...

The remote Spark driver is the application launched in the Spark cluster, that submits the actual Spark job.  It It was introduced in HIVE-8528.  It It is a long-lived application initialized upon the first query of the current user, running until the user's session is closed.  The The following properties control the remote communication between the remote Spark driver and the Hive client that spawns it.

hive.spark.client.future.timeout

• Default Value: 60 seconds
• Added In: Hive 1.1.0 with HIVE-9337

...

hive.spark.client.connect.timeout

• Default Value: 1000 miliseconds
• Added In: Hive 1.1.0 with HIVE-9337

...

hive.spark.client.server.connect.timeout

• Default Value: 90000 miliseconds
• Added In: Hive 1.1.0 with HIVE-9337, default changed in same release with HIVE-9519

Timeout for handshake between Hive client and remote Spark driver. Checked by both processesTimeout for remote Spark driver in connecting back to Hive client.

hive.spark.client.secret.bits

• Default Value: 256
• Added In: Hive 1.1.0 with HIVE-9337

Number of bits of randomness in the generated secret for communication between Hive client and remote Spark driver.  Rounded Rounded down to nearest multiple of 8.

hive.spark.client.rpc.threads

• Default Value: 8
• Added In: Hive 1.1.0 with HIVE-9337

...

Channel logging level for remote Spark driver.  One of DEBUG, ERROR, INFO, TRACE, WARN.  If If unset, TRACE is chosen.

Tez

...