Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
languagejava
titleFailureHandlingResult class extension
public class FailureHandlingResult {
	@Nullable private final Integer executionIndex;
}

Black list

...

Most long tail tasks are caused by machine problems, so the speculative execution must runs on a different machine from origin execution.

I will introduce blacklist module into Flink used for filter node when the speculative executions are request slots.

concept of black list 

Blacklist is a kind of scheduling constraint. According to 

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-11000
 description this is a bigger feature.

There are several levels of blacklist, including (JobVertex, TaskManager) blacklist, (JobVertex Host) blacklist, (Job, TaskManager) blacklist, (Job, Host) blacklist, (Session, TaskManager) blacklist and (Session Host) blacklist.

I will implement (Job, Host) blacklist for speculative execution feature. In order to implement

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyFLINK-11000
  feiendly in the future, my interface also suit other blacklist descripted above.


Classes and Interfaces of (JobVertex Host) blacklist are:



Init black list 

where register?

...