THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
...
Discussion thread: https://lists.apache.org/x/thread.html/3441424fed2af339b8d83c6a8aeecbb4edc23f7859ed1ccf42b389e0@%3Cdev.flink.apache.org%3E
JIRA: FLINK-14019 (<- link to https://issues.apache.org/jira/browse/FLINK-14019)
Released:
Please keep the discussion on the mailing list rather than commenting on the wiki (wiki discussions get unwieldy fast).
...
It is necessary to support managing dependencies and environment through command line so that the python jobs with additional dependencies can be submitted via "flink run" and web UI or other approached in the future. The PythonDriver class will support several new options as follows:
Short Name | Full Name | Syntax | Description |
-pyfs | --pyFiles | -pyfs <file-path> | This option already exists but it only appends the file to client side PYTHONPATH currently. Now it will upload the file to cluster and append it to python worker’s PYTHONPATH, which is equivalent to "add_python_file". |
-pyexec | --python-executable-path | -pyexec <python-executable-path> | This option is equivalent to `TableEnvironment#get_config().set_python_executable()`. |
-pyreq | --python-requirements | -pyreq <requirements-file-path> <cache-dir-path> | This option is equivalent to "set_python_requirements". |
-pyarch | --python-archive | -pyarch <archive-file-path> <extract-name> | This option is equivalent to "add_python_archive". |
Implementation
Implementation of SDK API
...