Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

[

...

progress record]:

...

Proposed

...

time:

...

2022/04/29

...

Discussion

...

time:

...

Acceptance

...

time:

...

Complete

...

time:

...

[issues]:

...

https://github.com/apache/incubator-linkis/issues/2082

...

Document the state by adding a label to the LKIP page with one of “discussion”, “accepted”, “released”, “rejected”.

[email]:

[release]:

...

1.2.0

[proposer]:

Motivation & Background

The

...

new

...

features

...

introduced

...

by

...

linkis

...

in

...

1.1.0.

...

The

...

management

...

of

...

data

...

sources

...

supports

...

users

...

to

...

configure

...

the

...

relevant

...

configuration

...

of

...

data

...

source

...

connections,

...

and

...

by

...

using

...

these

...

connection

...

configurations,

...

create

...

connections

...

and

...

query

...

the

...

metadata

...

data

...

of

...

the

...

corresponding

...

library.

...

Metadata

...

service

...

positioning

...

for

...

data

...

sources

...

is

...

a

...

query

...

service

...

that

...

only

...

provides

...

metadata,

...

and

...

does

...

not

...

involve

...

modifying

...

metadata

...

information.

...

Therefore,

...

the

...

metadata

...

query

...

service

...

module

...

is

...

named:

...

linkis-metedata-manager-server

...

with

...

manager,

...

which

...

is

...

easy

...

to

...

cause

...

misunderstanding

...

and

...

does

...

not

...

match

...

the

...

function

...

positioning.

...

The

...

optimization

...

adjustment

...

is

...

manager->query,

...

that

...

is,

...

linkis-metedata-query-server.

...

At

...

present,

...

the

...

SDK

...

client

...

LinkisMetaDataRemoteClient

...

for

...

metadata

...

query

...

uses

...

the

...

data

...

source

...

id

...

to

...

associate

...

to

...

obtain

...

the

...

configuration.

...

For

...

upstream

...

users,

...

the

...

data

...

source

...

id

...

attribute

...

is

...

the

...

self-incrementing

...

id

...

of

...

a

...

data

...

table,

...

which

...

is

...

too

...

abstract

...

and

...

has

...

no

...

actual

...

specific

...

meaning.

...

It

...

is

...

recommended

...

to

...

optimize

...

For

...

association

...

through

...

the

...

data

...

source

...

name

...

parameter.

Basic concept

...

  • Data

...

  • source:

...

  • We

...

  • call

...

  • database

...

  • services

...

  • that

...

  • can

...

  • provide

...

  • data

...

  • storage

...

  • as

...

  • databases,

...

  • such

...

  • as

...

  • mysql/hive/kafka.

...

  • The

...

  • data

...

  • source

...

  • defines

...

  • the

...

  • configuration

...

  • information

...

  • for

...

  • connecting

...

  • to

...

  • the

...

  • actual

...

  • database.

...

  • The

...

  • configuration

...

  • information

...

  • is

...

  • mainly

...

  • the

...

  • address

...

  • required

...

  • for

...

  • the

...

  • connection

...

  • and

...

  • user

...

  • authentication

...

  • information.

...

  • ,

...

  • connection

...

  • parameters,

...

  • etc.

...

  • Metadata:

...

  • single

...

  • refers

...

  • to

...

  • the

...

  • metadata

...

  • of

...

  • the

...

  • database,

...

  • which

...

  • refers

...

  • to

...

  • the

...

  • data

...

  • that

...

  • defines

...

  • the

...

  • data

...

  • structure

...

  • and

...

  • the

...

  • data

...

  • of

...

  • various

...

  • object

...

  • structures

...

  • of

...

  • the

...

  • database.

...

  • For

...

  • example,

...

  • the

...

  • database

...

  • name,

...

  • table

...

  • name,

...

  • column

...

  • name,

...

  • field

...

  • length,

...

  • type

...

  • and

...

  • other

...

  • information

...

  • data

...

  • in

...

  • the

...

  • database.

Expect to achieve goals

...

  • Module

...

  • naming

...

  • adjustment

...

  • linkis-metedata-manager-server->linkis-metedata-query-server

...

  • Metadata

...

  • LinkisMetaDataRemoteClient

...

  • uses

...

  • the

...

  • key

...

  • input

...

  • parameter

...

  • to

...

  • adjust

...

  • from

...

  • the

...

  • data

...

  • source

...

  • id

...

  • to

...

  • the

...

  • data

...

  • source

...

  • name

...

  • name

Implementation plan

...

  • 1.

...

  • When

...

  • the

...

  • client

...

  • builds

...

  • the

...

  • request

...

  • entity

...

  • class

...

  • object,

...

  • the

...

  • original

...

  • dataSourceId

...

  • is

...

  • adjusted

...

  • to

...

  • the

...

  • name dataSourceName 
  • 2.

...

  • The

...

  • input

...

  • parameter

...

  • of

...

  • the

...

  • relevant

...

  • back-end

...

  • http

...

  • interface

...

  • is

...

  • adjusted

...

  • from

...

  • the

...

  • original

...

  • dataSourceId

...

  • to

...

  • dataSourceName,

...

  • and

...

  • the

...

  • data

...

  • source

...

  • configuration

...

  • is

...

  • queried

...

  • through

...

  • dataSourceName

...

  • to

...

  • connect

...

  • to

...

  • the

...

  • database

...

Things

...

to

...

Consider

...

&

...

Note:

...

  • Do

...

  • you

...

  • need

...

  • to

...

  • consider

...

  • the

...

  • compatibility

...

  • of

...

  • the

...

  • original

...

  • parameter

...

  • method?

Changes


Modification Detail
1
Modification of maven module
none


2Modification of HTTP interfacenone
3Modification of the client interfacenone
4Modification of database table structurenone
5Modification of configuration itemnone
6Modification Error code none
7Modifications for Third Party Dependenciesnone

Compatibility, Deprecation, and Migration Plan

  • What impact (if any) will there be on existing users?
  • If we are changing behavior, how will we phase out the older behavior?
  • If we require special migration tools, describe them here.
  • When will we remove the existing behavior?