...

The blocklist mechanism will be an optional feature which the user has to activate explicitly by setting the config option cluster.resource-blocklist.enabled: true. This entails that Flink's default behavior won't change.

Future improvements

...

Automatically detect abnormal resources

We intend to introduce a configurable blocklist strategy may introduce an auto-detection mechanism in the future. Users can specify  exceptions for which the strategy should blocklist the resources. This requires adding several configuration options to configure exceptions and the generated blocklist item, which requires further design and discussion.

Introduce plugin mechanism for blocklist strategy

We may introduce a plugin mechanism in the future, which allows To do that, we need to introduce a pluggable abnormal resources detector and allow users to load their own blocklist strategy implementations. This means that BlocklistStrategy the detector needs to be opened to users as a public interface, which requires more thought and discussion.

Test Plan

1. The changes will be covered by unit and IT cases.
2. Test the functionality in a real Standanlone/Yarn/Kubernetes cluster.

...