Memory settings
Cluster Size | Recommended Mode | Collector Heapsize ams-env : metrics_collector_heapsize | HBase Master Heapsize ams-hbase-env : hbase_master_heapsize | HBase RS Heapsize ams-hbase-env : hbase_regionserver_heapsize | HBase Master xmn size ams-hbase-env : hbase_master_heapsizexmn_size | HBase Master HeapsizeRS xmn size ams-hbase-env : hbaseregionserver_masterxmn_heapsizesize |
---|---|---|---|---|---|---|
1 - 10 | Embedded | 512 | 1408 | 512 | 192 | - |
11 - 20 | Embedded | 1024 | 1920 | 512 | 256 | - |
21 - 100 | Embedded | 1664 | 5120 | 512 | 768 | - |
100 - 300 | Embedded | 4352 | 13056 | 512 | 2048 | - |
300 - 500 | Distributed | 4352 | 512 | 13056 | 102 | 2048 |
500 - 800 | Distributed | 7040 | 512 | 21120 | 102 | 3072 |
800 - 1000 | Distributed | 11008 | 512 | 32768 | 102 | 5120 |
1000+ | Distributed | 13696 | 512 | 32768 | 102 | |
5120 |
Advanced Configurations
Configuration | Property | Description | Minimum Recommended values (Host Count => MB) |
---|---|---|---|
ams-env | metrics_collector_heapsize | Metrics Collector Heap Size. API server + Aggregators | 1 - 50 => 1024 50 - 200 => 2048 200 - 400 => 4096 400 - 800 => 8192 800+ => 12288 |
ams-hbase-env | hbase_regionserver_heapsize | ) | 1 - 50 => 2048 50 - 200 => 8192 200 - 400 => 12288 400 - 800 => 16384 800+ => 32768 |
ams-hbase-env | hbase_master_heapsize | Based on embedded mode vs distributed this should be tuned. If embedded mode, tune one of these, hbase_master_heapsize or hbase_regionserver_heapsize, based on the row above. | |
ams-hbase-env | regionserver_xmn_size
| HBase RegionServer maximum value for young generation heap size. | 1 - 50 => 128 50 - 200 => 256 200 - 400 => 512 400 - 800 => 1024 800+ => 2048 |
ams-hbase-env | hbase_master_xmn_size | Based on embedded mode vs distributed this should tuned. If embedded mode, tune this based on the row above instead of regionserver_xmn_size | |
ams-site | phoenix.query.maxGlobalMemoryPercentage | Percentage of total heap memory used by Phoenix threads in the Metrics Collector API/Aggregator daemon. | 20 - 30, based on available memory. Default = 25. |
ams-site | phoenix.spool.directory | Set directory for Phoenix spill files. (Client side) | Set this to different disk from hbase.rootdir dir if possible. |
ams-hbase-site | phoenix.spool.directory | Set directory for Phoenix spill files. (Server side) | Set this to different disk from hbase.rootdir dir if possible. |
ams-hbase-site | phoenix.query.spoolThresholdBytes | Threshold size in bytes after which results from parallelly executed query results are spooled to disk. | Set this to higher value based on available memory. Default is 12 mb. |
...