...
By default, the cache that ORC input format uses to store the ORC file footer uses hard references for the cached object. Setting this to true can help avoid out-of-memory issues under memory pressure (in some cases) at the cost of slight unpredictability in overall query performance.
hive.io.sarg.cache.max.weight.mb
- Default Value:
10
- Added In: Hive 2.2.0, Hive 2.4.0, Hive 3.0.0 with HIVE-17669
The max weight allowed for the SearchArgument Cache. By default, the cache allows a max-weight of 10MB, after which entries will be evicted. Set to 0, to disable SearchArgument caching entirely.
hive.orc.compute.splits.num.threads
...