Versions Compared

Old Version 18

changes.mady.by.user Lefty Leverenz

Saved on

compared with

New Version 19

changes.mady.by.user Lefty Leverenz

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: minor reformats after toc fix

...

Config Param

Description

javax.jdo.option.ConnectionURL

JDBC connection string for the data store which contains metadata

javax.jdo.option.ConnectionDriverName

JDBC Driver class name for the data store which contains metadata

hive.metastore.uris

Hive connects to this URI to make metadata requests for a remote metastore

hive.metastore.local

local or remote metastore (Removed as of Hive 0.10: If If hive.metastore.uris is empty local mode is assumed, remoteotherwise)

hive.metastore.warehouse.dir

URI of the default location for native tables

...

Variable Name

Description

Default Value

hive.metastore.metadb.dir

 

 

hive.metastore.usefilestore

 

 

hive.metastore.rawstore.impl

 

 

org.jpox.autoCreateSchema

Creates necessary schema on startup if one doesn't exist. (e.g. tables, columns...) Set to false after creating it once.

 

org.jpox.fixedDatastore

Whether the datastore schema is fixed.

 

datanucleus.autoStartMechanism

Whether to initialize on startup.

 

hive.metastore.checkForDefaultDb

 

 

hive.metastore.ds.connection.url.hook

Name of the hook to use for retriving the JDO connection URL. If empty, the value in javax.jdo.option.ConnectionURL is used as the connection URL

 

hive.metastore.ds.retry.attempts

The number of times to retry a call to the backing datastore if there were a connection error

1

hive.metastore.ds.retry.interval

The number of miliseconds between datastore retry attempts

1000

hive.metastore.server.min.threads

Minimum number of worker threads in the Thrift server's pool.

200

hive.metastore.server.max.threads

Maximum number of worker threads in the Thrift server's pool.

10000

...

 

Warning
titleConfiguring datanucleus.autoStartMechanism is highly recommended

Configuring auto start for data nucleus is highly recommended. See HIVE-4762 for more details.

Code Block
 <property>
    <name>datanucleus.autoStartMechanism</name>
    <value>SchemaTable</value>
  </property>

...

Config Param

Config Value

Comment

javax.jdo.option.ConnectionURL

jdbc:derby:;databaseName=
../build/test/junit_metastore_db;create=true

Derby database located at hive/trunk/build...

javax.jdo.option.ConnectionDriverName

org.apache.derby.jdbc.EmbeddedDriver

Derby embeded JDBC driver class

hive.metastore.uris

not needed since this is a local metastore

 

hive.metastore.local

true

embeded is local

hive.metastore.warehouse.dir

file://${user.dir}/../build/ql/test/data/warehouse

unit test data goes in here on your local filesystem

...

In remote metastore setup, all Hive Clients will make a connection to a metastore server which in turn queries the datastore (MySQL in this example) for metadata. Metastore server and client communicate using Thrift Protocol. Starting with Hive 0.5.0, you can start a Thrift server by executing the following command:

...

No Format
hive --service metastore

...

In versions of Hive earlier than 0.5.0, it's instead necessary to run the Thrift server via direct execution of Java:
...
 No Format
$JAVA_HOME/bin/
...
java  -Xmx1024m -Dlog4j.configuration=file://$HIVE_HOME/conf/hms-log4j.properties -Djava.library.path=$HADOOP_HOME/lib/native/Linux-amd64-64/ -cp $CLASSPATH org.apache.hadoop.hive.metastore.HiveMetaStore
 
If you execute Java directly, then JAVA_HOME, HIVE_HOME, HADOOP_HOME must be correctly set; CLASSPATH should contain Hadoop, Hive (lib and auxlib), and Java jars.
...
To change the metastore port, use this hive command: 
 No Format
hive --service metastore -p <port_num>
Metastore Schema Consistency and Upgrades
...