Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

According to FLIP-49, we can sort out a table containing the correspondence between configuration and metric.


JVM

VM

Flink Compose0

user conf key1

configuration key2

metric max3

metric used3

JVM

JVM

Heap


FrameWork Heap

taskmanager.memory.framework.heap.size

memoryConfiguration.frameworkHeap

Status.JVM.Memory.Heap.Max

Status.JVM.Memory.Heap.Used

Task Heap

taskmanager.memory.task.heap.size

memoryConfiguration.taskHeap

JVM Non

Off-Heap








Native
JVM MetaSpace

Managed Memory

taskmanager.memory.

jvm-metaspace

managed.size

memoryConfiguration.

jvmMetaspace.Metaspace.Max

managedMemory

Status.

JVM.Memory

ManagedMemory.Total 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

19617

14406

Status.

JVM.Memory.Metaspace

ManagedMemory.Used 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

19617JVM Overhead

14406

Direct




FrameWork OffHeap

taskmanager.memory.

jvm

framework.off-

overhead

heap.

min

size

memoryConfiguration.

jvmOverhead

frameworkOffHeap

Status.JVM.Memory.

NonHeap.Max

Status.JVM.Memory.NonHeap.Used

taskmanager.memory.jvm-overhead.max

other

-

-

Outside JVM

Mapped

-

-

-

Status.JVM.Memory.Mapped.TotalCapacity

Status.JVM.Memory.Mapped.MemoryUsed

Direct

FrameWork OffHeap

taskmanager.memory.framework.off-heap.size

memoryConfiguration.frameworkOffHeap

Status.JVM.Memory.

Direct.TotalCapacity - Status.Shuffle.Netty.TotalMemory

Status.JVM.Memory.Direct.MemoryUsed - Status.Shuffle.Netty.UsedMemory

Task OffHeap Memory

taskmanager.memory.task.off-heap.size

memoryConfiguration.taskOffHeap

Network Memory

taskmanager.memory.network.min

memoryConfiguration.networkMemory

Status.Shuffle.Netty.TotalMemory 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-14422

Status.Shuffle.Netty.UsedMemory 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-14422

taskmanager.memory.network.max

Flink Managed

Mapped

-

-

-

Status.JVM.Memory.Mapped.TotalCapacity

Status.JVM.Memory.Mapped.MemoryUsed

Metaspace

JVM Metaspace

Managed Memory

taskmanager.memory.

managed

jvm-metaspace.size

memoryConfiguration.

managedMemory

jvmMetaspace

Status.JVM.Memory.

ManagedMemory

Metaspace.

Total 

Max

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-

14406

19617

Status.JVM.

ManagedMemory

Memory.Metaspace.Used

 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK

-14406

-19617

Overhead

JVM Overhead

taskmanager.memory.jvm-overhead.min

memoryConfiguration.jvmOverhead

Status.JVM.Memory.NonHeap.Max



Status.JVM.Memory.NonHeap.Used

taskmanager.memory.jvm-overhead.max

0 
1 These are the configuration parameters used in the Flink configuration.
2 Additionally, memoryConfiguration.totalFlinkMemory  and totalProcessMemory are exposed through the REST API.
3 The metrics which are exposed through the metrics endpoint.

...