You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Guide for contributors to the metastore on hbase development work. Umbrella JIRA - HIVE-9452

 

Setup for running hive against hbase metastore - 

Once you’ve built the code from the HBase metastore patch, here’s how to make it run against HBase:

 

  1. Install HBase, you want HBase 0.98 as that’s what we use internally.
  2. Setup HBase, http://hbase.apache.org/book.html#quickstart  I run it in stand alone mode, so you have to set a couple of values in hbase-site.xml for this to work.
  3. Set HADOOP_HOME if you’re not in a cluster where hadoop is already on your path.
  4. Start HBase: $HBASE_HOME/bin/start-hbase.sh
  5. Set it up so that HBase jars and conf file are picked up by Hive
    1. export HIVE_AUX_JARS_PATH=$HBASE_HOME/lib/
    2. Export AUX_CLASSPATH=$HBASE_HOME/conf
  6. Configure Hive to use HBase as its metastore, in hive-site.xml:
<property>
    <name>hive.metastore.rawstore.impl</name>
    <value>org.apache.hadoop.hive.metastore.hbase.HBaseStore</value>
  </property>
  <property>
    <name>hive.metastore.fastpath</name>
    <value>true</value>
  </property>

 

Now start Hive as normal, all should just work.

hive --service hbaseschematool install

creates all the hbase tables.

Design Docs

Overall Approach

Hbase execution plans for RawStore partition filter condition

 

  • No labels