...
Code Block | ||||
---|---|---|---|---|
| ||||
public class FailureHandlingResult { @Nullable private final Integer executionIndex; } |
Black list
...
Most long tail tasks are caused by machine problems, so the speculative execution must runs on a different machine from origin execution.
I will introduce blacklist module into Flink used for filter node when the speculative executions are request slots.
concept of black list
Blacklist is a kind of scheduling constraint. According to
description this is a bigger feature. Jira server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key FLINK-11000
There are several levels of blacklist, including (JobVertex, TaskManager) blacklist, (JobVertex Host) blacklist, (Job, TaskManager) blacklist, (Job, Host) blacklist, (Session, TaskManager) blacklist and (Session Host) blacklist.
I will implement (Job, Host) blacklist for speculative execution feature. In order to implement
feiendly in the future, my interface also suit other blacklist descripted above. Jira server ASF JIRA serverId 5aa69414-a9e9-3523-82ec-879b028fb15b key FLINK-11000
Classes and Interfaces of (JobVertex Host) blacklist are:
Init black list
where register?
...