THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Sub-Systems
- Configuration: Manage system configuration
- Repository Manager:** Create Repository Schema** Create or edit connectors
- Create or edit Connections
- Create or edit Jobs
- Connector Manager** Verify connectors** Register new connectors
- Edit connectors (enable/disable)
- Job Manager:** Submit new jobs to MR** Get Progress of Jobs from MR
- Kill specific job when requested
Initialization
- Configuration** Initialize configuration system
- Initialize logging infrastructure
- Repository Manager** Create repository Schema
- Verify if the schema is accurate
- Connector Manager** Register connectors
- Verify that all connector information is accurate
- Job Manager** Verify the status of jobs that were running at the time of last shutdown
Metadata
Component |
Resource |
Metadata |
Connector |
sc2, sc3 |
- Information needed to create connection |
Connection |
sx2, sx3 |
- Which connector backs this connection |
Job |
sj2, sj3 |
- Which connection the job is associated with |
Connector Metadata
- Information needed by the connector to create a connection
- Information needed by the connector to create a job, given a connection
Resources
Id |
Resource |
Method |
Action/Parameters |
sv1 |
/versions |
GET |
Return a list of supported protocol versions. Current list includes “1” only. |
sc1 |
/v1/connector |
GET |
Return a list of available connectors. |
sc2 |
/v1/connector/all |
GET |
Return a list of connectors with each connector’s metadata. |
sc3 |
/v1/connector/cid |
GET |
Return the metadata of the connector identified by cid |
sc4 |
/v1/connector/cid |
POST |
Enable or disable a connector. “ENABLE” → true|false |
sx1 |
/v1/connection |
GET |
Return a list of available connections. |
sx2 |
/v1/connection/all |
GET |
Return a list of available connections with metadata about each. |
sx3 |
/v1/connection/xid |
GET |
Return the metadata about connection identified by xid |
sx4 |
/v1/connection |
POST |
Create connection. “ENABLE” → true|false, Plus connector specific connection metadata |
sx6 |
/v1/connection/xid |
PUT |
Edit connection. |
sx5 |
/v1/connection/xid |
DELETE |
Delete connection. |
sj1 |
/v1/job |
GET |
Return a list of available jobs. |
sj2 |
/v1/job/all |
GET |
Return a list of available jobs with their configuration metadata. |
sj3 |
/v1/job/jid |
GET |
Return the metadata about job identified by jid |
sj4 |
/v1/job/jid |
POST |
Create or Edit job. “ENABLE” → true|false, Plus job specific metadata including pre-existing connection. |
sj5 |
/v1/job/jid |
DELETE |
Delete job |
ss1 |
/v1/status |
GET |
List of all jobs that are running |
ss2 |
/v1/status/all |
GET |
List of all jobs that are running with details about each job’s progress |
ss3 |
/v1/status/jid |
GET |
Details of th job identified by jid |
st1 |
/v1/jobcontrol |
POST |
Starts/Stop/Kill a job. “JOBID” → Sqoop specific Job ID |
sn1 |
/v1/notification |
POST |
Notification support for job progress |