Page History

...

With the flip proposed change in dynamic source parallelism inference, if user has configured the `execution.batch.adaptive.auto-parallelism.default-source-parallelism`, the configured value will serve as the upper bound for dynamic source parallelism inference. If this is not configured by the user, it will fallback to the `execution.batch.adaptive.auto-parallelism.max-parallelism`'configured value (the global adaptive parallelism inference upper bound). Should this also be unconfigured, the process will continue to fallback to `parallelism.default` as the final parallelism upper bound for dynamic source parallelism inference. Therefore, for most users, it is sufficient to only configure parallelism.default to control the upper bound of parallelism inference, which makes the configuration more concise.

...