Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Background

As we will move to a new data quality workflow, we also need to update griffin related scheduler to meet workflow's needs as below

  • time-based schedule capability, as create job(workflow) to be run at a specified time or intervals.
  • manage jobs lifecycle such as init, start, pause/resume, stop, delete, kill, retry, etc.periodically start/retry/clean workflow
  • coordinate recording/evaluating/alerting tasks within workflow
  • create jobs to be run at a specified time, and at specific intervals if the job requires to be run periodically.
  • delete or update jobs
  • job(workflow).
  • query the status of a job (running, failed, finished, etc), and its execution histories
  • prioritize a job. 
  • jobs are asynchronous.
  • high availablehigh available, so that one scheduler node is down, jobs(including half-done jobs) can failover to another node.