THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Current state: Under Discussion
Discussion thread: here (<- link to https://mail-archiveslists.apache.org/thread.html/a4dd8e0c7b79350c59f5afefc1bc583dac99abcf94caaa8c22017974@%3Cdev.flink.apache.org%3Emod_mbox/flink-dev/)
JIRA: here (<- link to https://issues.apache.org/jira/browse/FLINK-XXXX)
...
Given that this FLIP does not introduce any new feature, but rather tries to map already existing options to configuration options, we would like one major point of the discussion to be the naming conventions used here, so please comment also on the names used.
Proposed Changes
| Suggested name | Comment | Value Type | Pre-existing option |
|---|---|---|---|
| execution.target | The deployment target for the execution, e.g. "local" for local execution. | String - no default | CLI: -m |
| execution.attached | Submitting the job in attached or detached mode. | Boolean - default false | CLI: -d |
| execution.shutdown-on-attached-exit | If the job is submitted in attached mode, perform a best-effort cluster shutdown when the CLI is terminated abruptly, e.g. with CTRL-C. | Boolean - default false | CLI: -sae |
| parallelism.default (existing) | The parallelism for the execution. | Integer - default 1 | CLI: -p |
| execution.savepoint.path | The location of the savepoint to use to bootstrap the state when starting from a savepoint. | String - no default | CLI: -s |
| execution.savepoint.ignore-unclaimed-state | Allow to skip savepoint state that cannot be restored, e.g. if an operator was removed from the pipeline after the savepoint was taken. | Boolean - false | CLI: -n |
| pipeline.jars | A semicolon-separated list of the jars to package with the job jars to be sent to the cluster. | String - no default | ProgramOptions.jarPath and RemoteExecutor.jarfiles |
| pipeline.classpaths | A semicolon-separated list of the classpaths to package with the job jars to be sent to the cluster. | String - no default | ProgramOptions.classpaths and RemoteExecutor.globalClasspaths |
| yarn.log-config-file | The location of the log config file, e.g. the path to your log4j.properties for log4j. | String - no default | It was silently discovered in the YarnClusterDescriptor.startAppMaster() |
| yarn.ship-directories | A semicolon-separated list of directories to be shipped to the YARN cluster. | String - no default | YarnCLI: -yt |
| yarn.flink-dist-jar | The location of the Flink dist jar | String - no default | YarnCLI: -yj |
| yarn.application.id | The application id of the running yarn cluster. | String - no default | YarnCLI: -yid |
| yarn.application.queue | The YARN queue on which to put the current pipeline. | String - no default | YarnCLI: -yqu |
| yarn.application.name | A custom name for your YARN application | String - no default | YarnCLI: -ynm |
| yarn.application.type | A custom type for your YARN application | String - no default | YarnCLI: -yat |
| yarn.application.node-label | Specify YARN node label for the YARN application | String - no default | YarnCLI: -ynl |
Compatibility, Deprecation, and Migration Plan
...