State
[progress record]:
Proposed time: 2022/05/26
Discussion time:
Acceptance time:
Complete time:
[issues]:
[email]:
[release]:
[proposer]:peacewong
Motivation & Background
At present, Linkis can only connect to a single Hadoop cluster. If the company has multiple Hadoop clusters, it will be difficult to operate and maintain. It is recommended that Linkis can support multiple Hadoop clusters.
Basic concept
Expect to achieve goals
- 1. LinkisManager supports selecting the ECM of the corresponding cluster when selecting ECM
- 2. LinkisManager supports Yarn queue resources for managing multiple clusters
- 3. publicservice supports reading the result sets of multiple clusters, and manages and controls them through the hadoop conf of multiple clusters
Things to Consider & Note:
- How does publicservice get the Hadoop conf of multiple clusters
Implementation plan
Briefly list the solutions implemented by this proposal and the points that may need attention, as accurate as possible, and the content should be adjusted and revised according to the actual completion process.
Changes
Modification | Detail | |
---|---|---|
1 | Modification of maven module | |
2 | Modification of HTTP interface | |
3 | Modification of the client interface | |
4 | Modification of database table structure | |
5 | Modification of configuration item | |
6 | Modification Error code | |
7 | Modifications for Third Party Dependencies |
Compatibility, Deprecation, and Migration Plan
- What impact (if any) will there be on existing users?
- If we are changing behavior, how will we phase out the older behavior?
- If we require special migration tools, describe them here.
- When will we remove the existing behavior?