Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Document CachedStore properties

...

As of Hive 3.0 there are two implementations. The default implementation (ObjectStore) queries the database directly. HIVE-16520 introduced a new CachedStore (full class name is org.apache.hadoop.hive.metastore.cache.CachedStore) that caches retrieved objects in memory on the Metastore.

metastore.cached.rawstore.impl
  • Default Value:org.apache.hadoop.hive.metastore.ObjectStore
  • Added in: Hive 3.0

If you're using the CachedStore this is the name of the wrapped RawStore class to use.

metastore.cached.rawstore.cache.update.frequency
  • Default Value: 60
  • Added in: Hive 3.0.0

The time - in seconds - after which the metastore cache is updated from the metastore DB.

metastore.cached.rawstore.cached.object.whitelist
  • Default Value: .*
  • Added in: Hive 3.0.0

Comma separated list of regular expressions to select the tables (and its partitions, stats etc) that will be cached by CachedStore. This can be used in conjunction with hive.metastore.cached.rawstore.cached.object.blacklist.

Example: .*, db1.*, db2\.tbl.*. The last item can potentially override patterns specified before.

metastore.cached.rawstore.cached.object.blacklist
  • Default Value: (empty)
  • Added in: Hive 3.0.0

Comma separated list of regular expressions to filter out the tables (and its partitions, stats etc) that will be cached by CachedStore. This can be used in conjunction with hive.metastore.cached.rawstore.cached.object.whitelist.

Example: db2.*, db3\.tbl1, db3\..*. The last item can potentially override patterns specified before.

metastore.cached.rawstore.max.cache.memory
  • Default Value: 1gb
  • Added in: Hive 3.0.0

The maximum memory in bytes that the cached objects can use. Memory used is calculated based on estimated size of tables and partitions in the cache. Setting it to a negative value disables memory estimation.

hive.metastore.batch.retrieve.max

...

Name of the hook to use for retriving retrieving the JDO connection URL. If empty, the value in javax.jdo.option.ConnectionURL is used.

...