Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Install HBase, preferably HBase 01.1.98 1 as that’s what is being used for testing.
  2. Copy following jars into $HBASE_HOME/lib
    1. hive-common-1.*.jar

    2. hive-metastore-1.*.jar

    3. hive-serde-1.*.jar

  3. Setup HBase, http://hbase.apache.org/book.html#quickstart  I run it in stand alone mode, so you have to set a couple of values in hbase-site.xml for this to work.
  4. Set HADOOP_HOME if you’re not in a cluster where hadoop is already on your path.
  5. Start HBase: $HBASE_HOME/bin/start-hbase.sh
  6. Set it up so that HBase jars and conf file are picked up by Hive
    1. export HIVE_AUX_JARS_PATH=$HBASE_HOME/lib/
    2. export AUX_CLASSPATH=$HBASE_HOME/conf
  7. Create the metastore tables in HBase: hive --service hbaseschematool install
  8. Configure Hive to use HBase as its metastore, in hive-site.xml:

...

  • Currently (as of Apr 8 2015) we have not tested the HBase metastore with the metastore service.  We don't know if it works or not.  We have tested it with the command line client and HiveServer2.
  • Not all Hive operations have been tested.  Insert, select, create table, drop table, create database, add partition, drop partition have been tested.  Other features may not work.  
  • Once we switched to HBase 1.1.1, Tephra no longer works.  You'll need to use the VanillaHBaseConnection (which is the default) until we get Tephra working again.

 

Importing metadata from rdbms to hbase 

...