Pre-flight Phase

batch or streaming producing a JobGraph


JobClient

 library upload

 job graph submission


JobManager

Library cache setup

execution graph creation, attaching to previous graph

master side initialization

streaming fault tolerance coordinator start

trigger scheduling

deploy task executions

 

TaskManager

Receive Task deployment

download libraries (if needed)

setup input / output readers and writers

create task thread

send status updates

 

  • No labels

1 Comment

  1. Questions about the "library upload" in JobClient. Is the library mentioned here refers to a jar file ?