Page History

...

LLAP adds the following properties. 

hive.llap.execution.mode

• Default Value:  none
• Added In: Hive 2.0.0 with ..

...

hive.tez.input.generate.consistent.splits

• Possible Values: auto, none, all, map
• Default Value: 
• Added In: Hive 2.0.0 with ..

...Chooses whether query fragments will run in container or in LLAP

hive.server2.llap.concurrent.queries

• Default Value:  -1
• Added In: Hive 2.0.0 with ..

The number of queries allowed in parallel via llap. ..Negative number implies 'infinite'.

LLAP I/O

hive.llap.io.enabled

• Default Value:  null
• Added In: Hive 2.0.0 with ..

...

hive.llap.io.cache.

...

orc.

...

alloc.

...

min

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.io.cache.orc.alloc.

...

max

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.io.cache.orc.

...

arena.

...

size

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.io.cache.orc

...

.size

• Default Value:  1Gb
• Added In: Hive 2.0.0 with ..

...

Maximum size for IO allocator or ORC low-level cache.

hive.llap.io.

...

threadpool.size

• Default Value:  10
• Added In: Hive 2.0.0 with ..

Specify the number of threads to use for low-level IO thread pool.

...

hive.llap.io.orc.

...

time.

...

counters

• Default Value:  true
• Added In: Hive 2.0.0 with ..

...

Whether to enable time counters for LLAP IO layer (time spent in HDFS, etc.)

hive.llap.io.

...

memory.

...

mode

• Default Value:  cache
• Added In: Hive 2.0.0 with ..

...

• Possible Values: cache, allocator, none
• Added In: Hive 2.0.0 with HIVE-12597

LLAP IO memory usage;

'cache' (the default) uses data and metadata cache with a custom off-heap allocator,
'allocator' uses the custom allocator without the caches,
'none' doesn't use either (this mode may result in significant performance degradation)

hive.llap.io.allocator.

...

alloc.

...

min

• Default Value:  128Kb
• Added In: Hive 2.0.0 with ..0 with HIVE-12597

Minimum allocation possible from LLAP buddy allocator. Allocations below that are padded to minimum allocation.
For ORC, should generally be the same as the expected compression buffer size, or next lowest power of 2. Must be a power of 2....

hive.llap.io.

...

allocator.alloc.

...

max

• Default Value:  16Mb
• Added In: Hive 2.0.0 with ..0 with HIVE-12597

Maximum allocation possible from LLAP buddy allocator. For ORC, should be as large as the largest expected ORC compression buffer size. Must be a power of 2...

hive.llap.io.

...

allocator.

...

arena.

...

count

• Default Value:  8
• Added In: Hive 2.0.0 with ..0 with HIVE-12597

Arena count for LLAP low-level cache; cache will be allocated in the steps of (size/arena_count) bytes. This size must be <= 1Gb and >= max allocation; if it is not the case, an adjusted size will be used. Using powers of 2 is recommended...

hive.llap.io.memory.

...

size

• Default Value:  1Gb
• Added In: Hive 2.0.0 with HIVE-12597

..Maximum size for IO allocator or ORC low-level cache.

hive.llap.io.allocator.

...

direct

• Default Value: 
• Added In: Hive 2.0.0 with HIVE-12597

...

LLAP CBO

hive.llap.

...

auto.

...

allow.

...

uber

• Default Value:  true
• Added In: Hive 2.0.0 with HIVE-125970 with ..

Whether or not to allow the planner to run vertices in the AM...

hive.llap.

...

auto.

...

enforce.

...

tree

• Default Value:  true
• Added In: Hive 2.0.0 with HIVE-125970 with ..

Enforce that all parents are in llap, before considering vertex...

hive.llap.

...

auto.

...

enforce.

...

vectorized

• Default Value: 
• Added In: Hive 2.0.0 with HIVE-12597.0 with ..

...

hive.llap.

...

auto.

...

enforce.

...

stats

• Default Value: 
• Added In: Hive 2.0.0 with HIVE-12597.0 with ..

...

hive.llap.auto.

...

max.input.

...

size

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.auto.

...

max.output.

...

size

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.

...

object.

...

cache.

...

enabled

• Default Value:  true
• Added In: Hive 2.0.0 with ..

...Cache objects (plans, hashtables, etc) in LLAP

hive.llap.queue.

...

metrics.

...

percentiles.

...

intervals

• Default Value:  blank
• Added In: Hive 2.0.0 with ..

Comma-delimited set of integers denoting the desired rollover intervals (in seconds) for percentile latency metrics on the LLAP daemon producer-consumer queue...

By default, percentile latency metrics are disabled.

Whitelist based UDF support (HIVE-12852)

hive.llap.

...

daemon.

...

allow.

...

permanent.

...

fns

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.

...

daemon.

...

download.

...

permanent.

...

fns

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

LLAP Cache

hive.llap.

...

io.

...

use.

...

lrfu

• Default Value:  false
• Added In: Hive 2.0.0 with ..

...

Whether ORC low-level cache should use Least Frequently / Frequently Used (LRFU) cache policy instead of default First-In-First-Out (FIFO).

hive.llap.

...

io.

...

lrfu.

...

lambda

• Default Value: : 0.01f
• Possible Values: Between 0 and 1
• Added In: Hive 2.0.0 with ..

Lambda for ORC low-level cache LRFU cache policy. Must be in [0, 1].

0 makes LRFU behave like LFU, 1 makes it behave like LRU, values in between balance accordingly.

...

LLAP Security

hive.llap.daemon.

...

keytab.file

The path to the Kerberos Keytab file containing the LLAP daemon's service principal.

hive.llap.zk.sm.principal

The name of the principal to use to talk to ZooKeeper for ZooKeeper SecretManager.

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

hive.llap.

...

zk.

...

sm.

...

keytab.

...

file

The path to the Kerberos Keytab file containing the principal to use to talk to ZooKeeper for ZooKeeper SecretManager.

hive.llap.zk.sm.connectionString

ZooKeeper connection string for ZooKeeper SecretManager

• Default Value: 
• Added In: Hive 2.0.0 with ..

...

Transactions and Compactor

...