Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

To solve this problem, we propose to introduce a blacklist blocklist mechanism for Flink to filter out problematic resources. Following two ways will be introduced to blacklist blocklist resources:

  1. Manually specify the blacklisted blocklisted resources through REST API. When users find abnormal nodes/TMs, they can manually blocklist them in this way.
  2. Automatically detect abnormal resources and blocklist them. Users can specify a blacklist blocklist strategy which identifies abnormal resources. In the first version, we only introduce the blacklist blocklist strategy interface and a no-op implementation. In the future, we will introduce a configurable blacklist blocklist strategy and plugin mechanism to load user-defined blacklist blocklist strategy implementations.

...

We propose to introduce following configuration options for blacklistblocklist:

  • cluster.resource-blacklistblocklist.enabled: Whether to enable blacklist mechanism.
  • cluster.resource-blacklistblocklist.item.timeout: Timeout for blacklisted items in blacklist to be removed
  • cluster.resource-blacklistblocklist.item.timeout-check-interval: The check interval for blacklist items timeout.

...