Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Fixed table under Proposed Changes after having a chat about it in the team

...

This includes making JobManager's memory-related metrics available in the UI. Additionally, the configuration parameters should be exposed similar to the TaskManager's overview (see FLIP-102: Add More Metrics to TaskManager).

JVM

VM

Flink Compose

user conf key1

configuration key2

metric max3

metric used

JVM

3

JVM
Heap
FrameWork

Framework Heap

jobmanager.memory.heap.size

memoryConfiguration.

jvmHeap

frameworkHeap

Status.JVM.Memory.Heap.Max

Status.JVM.Memory.Heap.Used

JVM None

Off-Heap

JVM MetaSpace
Framework Off-Heapjobmanager.memory.
jvm
off-
metaspace
heap.sizememoryConfiguration.
jvmMetaspace
frameworkOffHeapStatus.JVM.Memory.
Metaspace
NonHeap.MaxStatus.JVM.Memory.
Metaspace
NonHeap.Used

JVM

Overhead

MetaSpace

jobmanager.memory.jvm-

overhead

metaspace.

min

size

memoryConfiguration.

jvmOverhead

jvmMetaspace

Status.JVM.Memory.

NonHeap

Metaspace.Max

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-19617

Status.JVM.Memory.

NonHeap

Metaspace.Used

jobmanager.memory.jvm-overhead.max

other

-

-

Outside JVM

Mapped

-

-

-

Status.JVM.Memory.Mapped.TotalCapacity

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-19617

JVM Overhead

jobmanager.memory.jvm-overhead.min

memoryConfiguration.jvmOverhead

Status.JVM.Memory.

Mapped.MemoryUsed

Direct

-

jobmanager.memory.off-heap.size

memoryConfiguration.jvmOffHeap

NonHeap.Max - Status.JVM.Memory.Metaspace.Max

Status.JVM.Memory.NonHeap.

MaxStatus

Used - Status.JVM.Memory.

NonHeap

Metaspace.Used

Native

-

jobmanager.memory.jvm-overhead.max

1 These are the configuration parameters used in the Flink configuration.
2 These are the Json paths to address the properties in the HTTP REST API response. Additionally, memoryConfiguration.totalFlinkMemory  and totalProcessMemory are exposed through the REST API.
3 The metrics which are exposed through the metrics endpoint.

Frontend Design

Display metrics inside JVM, outside JVM and GC

...