...
According to FLIP-49, we can sort out a table containing the correspondence between configuration and metric.
JVM |
VM
Flink Compose0 | user conf key1 | configuration key2 | metric max3 | metric used3 |
JVM
Heap | FrameWork Heap | memoryConfiguration.frameworkHeap | Status.JVM.Memory.Heap.Max | Status.JVM.Memory.Heap.Used | ||
Task Heap | memoryConfiguration.taskHeap |
Off-Heap | Native |
Managed Memory |
memoryConfiguration. |
managedMemory | Status. |
ManagedMemory.Total |
|
| Status. |
ManagedMemory.Used |
| ||
Direct | FrameWork OffHeap |
memoryConfiguration. |
frameworkOffHeap | Status.JVM.Memory. |
Status.JVM.Memory.NonHeap.Used
taskmanager.memory.jvm-overhead.max
other
-
-
Outside JVM
Mapped
-
-
-
Status.JVM.Memory.Mapped.TotalCapacity
Status.JVM.Memory.Mapped.MemoryUsed
Direct
FrameWork OffHeap
taskmanager.memory.framework.off-heap.size
memoryConfiguration.frameworkOffHeap
Direct.TotalCapacity - Status.Shuffle.Netty.TotalMemory | Status.JVM.Memory.Direct.MemoryUsed - Status.Shuffle.Netty.UsedMemory | |||||||||||||||||||
Task OffHeap Memory | memoryConfiguration.taskOffHeap | |||||||||||||||||||
Network Memory | memoryConfiguration.networkMemory | Status.Shuffle.Netty.TotalMemory | Status.Shuffle.Netty.UsedMemory | |||||||||||||||||
Flink Managed
Mapped | - | - | - | Status.JVM.Memory.Mapped.TotalCapacity | Status.JVM.Memory.Mapped.MemoryUsed |
Metaspace | JVM Metaspace |
memoryConfiguration. |
jvmMetaspace | Status.JVM.Memory. |
Metaspace. |
Max
|
| Status.JVM. |
Memory.Metaspace.Used |
|
| |||||
Overhead | JVM Overhead | memoryConfiguration.jvmOverhead | Status.JVM.Memory.NonHeap.Max | Status.JVM.Memory.NonHeap.Used | |
0
1 These are the configuration parameters used in the Flink configuration.
2 Additionally, memoryConfiguration.totalFlinkMemory
and totalProcessMemory
are exposed through the REST API.
3 The metrics which are exposed through the metrics endpoint.
...