Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Since we can not execute batch jobs with the DeclarativeSchedulerdeclarative scheduler, we need to be able to detect whether a job is a batch or a streaming job. For this purpose, we are introducing a new enum field in the JobGraph, called JobType.

...

Lastly, the Blink Table API / SQL Planner also generates StreamGraph instances, which contain batch jobs. We are tagging the StreamGraph as a batch job in the ExecutorUtils.setBatchProperties() method.

If we detect that the declarative scheduler has been configured for a batch job, we will fall back to another scheduler supporting batch jobs (currently the pipelined region scheduler).

Compatibility, Deprecation, and Migration Plan

...