...

JIRA:

Released: <Flink Version>

...

We will split this JIRA into two tasks.

The first task:

...

Ignore max buffers per channel when allocate buffer

The LocalBufferPool will be unavailable when the maxBuffersPerChannel is reached for this channel or availableMemorySegments.isEmpty.

...

The second task: Adding the overdraft buffer

Adding the new configuration : taskmanager.network.memory.max-overdraft-buffers-per-gate, the default value is 5~10?

...

For return memory segment, we will return the overdraft first if numberOfRequestedOverdraftMemorySegments > 0.

The third task: Compatible with LegacySource

Since LegacySource does not have checkAvailable, LegacySource will use all overdraft buffers by default, this is not what we expected.

So we'll detect the LegacySource and set overdraft=0 on the Task containing the LegacySource.

Compatibility, Deprecation, and Migration Plan

...