Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Memory settings

      
Cluster SizeRecommended Mode

Collector Heapsize

ams-env : metrics_collector_heapsize

HBase Master Heapsize

ams-hbase-env : hbase_master_heapsize

HBase RS Heapsize

ams-hbase-env : hbase_regionserver_heapsize

HBase Master xmn size

ams-hbase-env : hbase_master_heapsizexmn_size

HBase Master HeapsizeRS xmn size

ams-hbase-env : hbaseregionserver_masterxmn_heapsizesize

 1 - 10 Embedded 512 1408 512 192 -
 11 - 20 Embedded 1024 1920 512 256 -
 21 - 100 Embedded 1664 5120 512 768 -

100 - 300

 Embedded 4352 13056 512 2048 -
 300 - 500 Distributed 4352 512 13056 102 2048
 500 - 800 Distributed 7040 512 21120 102 3072
800 - 1000Distributed1100851232768 102 5120
 1000+ Distributed 13696 512 32768 102 
       
5120


Advanced Configurations

HBase RegionServer Heap Size. In embedded mode,

total heap size is sum of master and regionserver heap sizes.

(post Ambari 2.0. In 2.0 set master xmx only 
ConfigurationPropertyDescriptionMinimum Recommended values (Host Count => MB)
ams-envmetrics_collector_heapsize

Metrics Collector Heap Size.

API server + Aggregators

1 - 50     => 1024

50 - 200   => 2048

200 - 400 => 4096

400 - 800 => 8192

800+        => 12288

ams-hbase-envhbase_regionserver_heapsize)

1 - 50       => 2048

50 - 200   => 8192

200 - 400 => 12288

400 - 800 => 16384

800+        =>  32768

ams-hbase-envhbase_master_heapsize

Based on embedded mode vs distributed this should

be tuned. If embedded mode, tune one of these,

hbase_master_heapsize or hbase_regionserver_heapsize,

based on the row above.

 
ams-hbase-env

regionserver_xmn_size

 

HBase RegionServer maximum value for young

generation heap size.

1 - 50       => 128

50 - 200   => 256

200 - 400 => 512

400 - 800 => 1024

800+        => 2048

ams-hbase-envhbase_master_xmn_size

Based on embedded mode vs distributed this should

tuned. If embedded mode, tune this based on the row

above instead of regionserver_xmn_size

ams-sitephoenix.query.maxGlobalMemoryPercentage

Percentage of total heap memory used by Phoenix

threads in the Metrics Collector API/Aggregator daemon.

20 - 30, based on available memory. Default = 25.
ams-sitephoenix.spool.directorySet directory for Phoenix spill files. (Client side)Set this to different disk from hbase.rootdir dir if possible.
ams-hbase-sitephoenix.spool.directorySet directory for Phoenix spill files. (Server side)Set this to different disk from hbase.rootdir dir if possible.
ams-hbase-sitephoenix.query.spoolThresholdBytes

Threshold size in bytes after which results from parallelly

executed query results are spooled to disk.

Set this to higher value based on available memory.

Default is 12 mb.

...