Memory settings
Cluster Size | Recommended Mode | Collector Heapsize ams-env : metrics_collector_heapsize | HBase Master Heapsize ams-hbase-env : hbase_master_heapsize | HBase RS Heapsize ams-hbase-env : hbase_regionserver_heapsize | HBase Master xmn size ams-hbase-env : hbase_master_heapsize | HBase Master Heapsize ams-hbase-env : hbase_master_heapsize |
---|---|---|---|---|---|---|
Configuration | Property | Description | Minimum Recommended values (Host Count => MB) |
---|---|---|---|
ams-env | metrics_collector_heapsize | Metrics Collector Heap Size. API server + Aggregators | 1 - 50 => 1024 50 - 200 => 2048 200 - 400 => 4096 400 - 800 => 8192 800+ => 12288 |
ams-hbase-env | hbase_regionserver_heapsize | HBase RegionServer Heap Size. In embedded mode, total heap size is sum of master and regionserver heap sizes. (post Ambari 2.0. In 2.0 set master xmx only) | 1 - 50 => 2048 50 - 200 => 8192 200 - 400 => 12288 400 - 800 => 16384 800+ => 32768 |
ams-hbase-env | hbase_master_heapsize | Based on embedded mode vs distributed this should be tuned. If embedded mode, tune one of these, hbase_master_heapsize or hbase_regionserver_heapsize, based on the row above. | |
ams-hbase-env | regionserver_xmn_size
| HBase RegionServer maximum value for young generation heap size. | 1 - 50 => 128 50 - 200 => 256 200 - 400 => 512 400 - 800 => 1024 800+ => 2048 |
ams-hbase-env | hbase_master_xmn_size | Based on embedded mode vs distributed this should tuned. If embedded mode, tune this based on the row above instead of regionserver_xmn_size | |
ams-site | phoenix.query.maxGlobalMemoryPercentage | Percentage of total heap memory used by Phoenix threads in the Metrics Collector API/Aggregator daemon. | 20 - 30, based on available memory. Default = 25. |
ams-site | phoenix.spool.directory | Set directory for Phoenix spill files. (Client side) | Set this to different disk from hbase.rootdir dir if possible. |
ams-hbase-site | phoenix.spool.directory | Set directory for Phoenix spill files. (Server side) | Set this to different disk from hbase.rootdir dir if possible. |
ams-hbase-site | phoenix.query.spoolThresholdBytes | Threshold size in bytes after which results from parallelly executed query results are spooled to disk. | Set this to higher value based on available memory. Default is 12 mb. |