Guide for contributors to the metastore on hbase development work. Umbrella JIRA - HIVE-9452
Setup for running hive against hbase metastore -
Once you’ve built the code from the HBase metastore patch, here’s how to make it run against HBase:
- Install HBase, you want HBase 0.98 as that’s what we use internally.
- Setup HBase, http://hbase.apache.org/book.html#quickstart I run it in stand alone mode, so you have to set a couple of values in hbase-site.xml for this to work.
- Set HADOOP_HOME if you’re not in a cluster where hadoop is already on your path.
- Start HBase: $HBASE_HOME/bin/start-hbase.sh
- Set it up so that HBase jars and conf file are picked up by Hive
- export HIVE_AUX_JARS_PATH=$HBASE_HOME/lib/
- Export AUX_CLASSPATH=$HBASE_HOME/conf
- Configure Hive to use HBase as its metastore, in hive-site.xml:
<property> <name>hive.metastore.rawstore.impl</name> <value>org.apache.hadoop.hive.metastore.hbase.HBaseStore</value> </property> <property> <name>hive.metastore.fastpath</name> <value>true</value> </property>
Now start Hive as normal, all should just work.
hive --service hbaseschematool install
creates all the hbase tables.
Design Docs
Hbase execution plans for RawStore partition filter condition