THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
| Code Block | ||||
|---|---|---|---|---|
| ||||
public class JobVertex implements java.io.Serializable {
// ExecutionAttemptIDs of the fastest finished executions in all speculated ExecutionVertex in this jobVertex.
private Set<ExecutionAttemptID> fastAttemptIdsWithSpeculative = new HashSet<>();
// ExecutionAttemptIDs of the non-fastest finished executions in all speculated ExecutionVertex in this jobVertex.
private Set<ExecutionAttemptID> slowAttemptIdsWithSpeculative = new HashSet<>();
// ExecutionAttemptIDs of the success finished executions in all non-speculated ExecutionVertex in this jobVertex.
private Set<ExecutionAttemptID> finishedAttemptIdsWithoutSpeculative = new HashSet<>();
// All ExecutionAttemptIDs in this jobVertex.
private Set<ExecutionAttemptID> allAttemptIds = new HashSet<>();
} |
Moreover, FileOutputFormat need implements FinalizeOnMaster and add some code in open() and configure().
Metrics
For each ExecutionJobVertex, I use six metrics to measure and evaluate the efficiency of speculative execution that can be summarized in the job status and web page.
...