THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
| Table of Contents |
|---|
Low Latency Analytical Processing Live Long And Process (LLAP) functionality was added in Hive 2.0 (HIVE-7926 and associated tasks). HIVE-9850 links documentation, features, and issues for this enhancement.
...
LLAP servers are a natural place to enforce access control at a more fine-grained level than “per file”. Since the daemons know which columns and records are processed, policies on these objects can be enforced. This is not intended to replace the current mechanisms, but rather to enhance and open them up to other applications as well.
Monitoring
Configurations for LLAP monitoring are stored in resources.json, appConfig.json, metainfo.xml which are embedded into templates.py used by Slider.
LLAP Monitor Daemon runs on YARN container, similar to LLAP Daemon, and listens on the same port.
The LLAP Metrics Collection Server collects JMX metrics from all LLAP Daemons periodically.
The list of LLAP Daemons are extracted from the Zookeeper server which launched in the cluster.
Web Services
HIVE-9814 introduces the following web services:
JSON JMX data - /jmx
JVM Stack Traces of all threads - /stacks
XML Configuration from llap-daemon-site - /conf
HIVE-13398 introduces the following web services:
...
LLAP can be deployed via Slider, which bypasses node installation and related complexities (HIVE-9883).
LLAP Status Status
AMBARI-16149 introduces LLAP app status, available with Hive ServerHiveServer2.
Example usage.
/current/hive-server2-hive2/bin/hive --service llapstatus --name {llap_app_name} [-f] [-w] [-i] [-t]| Code Block | ||
|---|---|---|
| ||
-f,--findAppTimeout <findAppTimeout> Amount of time(s) that the tool will sleep to wait for the YARN application to start. negative values=wait
forever, 0=Do not wait. default=20s
-H,--help Print help information
--hiveconf <property=value> Use value for given property. Overridden by explicit parameters
-i,--refreshInterval <refreshInterval> Amount of time in seconds to wait until subsequent status checks in watch mode. Valid only for watch mode.
(Default 1s)
-n,--name <name> LLAP cluster name
-o,--outputFile <outputFile> File to which output should be written (Default stdout)
-r,--runningNodesThreshold <runningNodesThreshold> When watch mode is enabled (-w), wait until the specified threshold of nodes are running (Default 1.0
which means 100% nodes are running)
-t,--watchTimeout <watchTimeout> Exit watch mode if the desired state is not attained until the specified timeout. (Default 300s)
-w,--watch Watch mode waits until all LLAP daemons are running or subset of the nodes are running (threshold can be
specified via -r option) (Default wait until all nodes are running) |
| Info | ||
|---|---|---|
| ||
The findAppTimeout option was added in release 2.1.0 with HIVE-13643: The watch and running nodes options were added in release 2.2.0 with HIVE-15217 and HIVE-15651: |
Resources
Hive Contributor Meetup PresentationTry Hive LLAP
...