State

[progress record]:

Proposed time: 2022/05/26

Discussion time:

Acceptance time:

Complete time:

[issues]：

[email]：  

[release]:

[proposer]：peacewong

Motivation & Background

At present, Linkis can only connect to a single Hadoop cluster. If the company has multiple Hadoop clusters, it will be difficult to operate and maintain. It is recommended that Linkis can support multiple Hadoop clusters.

Basic concept

Expect to achieve goals

• 1. LinkisManager supports selecting the ECM of the corresponding cluster when selecting ECM
• 2. LinkisManager supports Yarn queue resources for managing multiple clusters
• 3. publicservice supports reading the result sets of multiple clusters, and manages and controls them through the hadoop conf of multiple clusters

Things to Consider & Note:

• How does publicservice get the Hadoop conf of multiple clusters

Implementation plan

Briefly list the solutions implemented by this proposal and the points that may need attention, as accurate as possible, and the content should be adjusted and revised according to the actual completion process.

Changes

Compatibility, Deprecation, and Migration Plan

• What impact (if any) will there be on existing users?
• If we are changing behavior, how will we phase out the older behavior?
• If we require special migration tools, describe them here.
• When will we remove the existing behavior?