Warning | ||
---|---|---|
| ||
The following information is relevant ONLY for releases before 1.99.4 |
Sub-Systems
- Configuration: Manage system configuration
- Repository Manager:** Create Repository Schema** Create or edit connectors** Create or edit Connections
- Create or edit Jobs
- Connector Manager** Verify connectors** Register new connectors** Edit connectors (enable/disable)
- Job Manager:** Submit new jobs to MR** Get Progress of Jobs from MR** Kill specific job when requested
Initialization
- Configuration** Initialize configuration system
- Initialize logging infrastructure
- Repository Manager** Create repository Schema
- Verify if the schema is accurate
- Connector Manager** Register connectors
- Verify that all connector information is accurate
- Job Manager** Verify the status of jobs that were running at the time of last shutdown
Metadata
Component | Resource | Metadata |
Connector | sc2, sc3 | - Information needed to create connection |
Connection | sx2, sx3 | - Which connector backs this connection |
Job | sj2, sj3 | - Which connection the job is associated with |
Connector Metadata
- Information needed by the connector to create a connection
- Information needed by the connector to create a job, given a connection
Resources
Green resources are currently implemented in current (2012-10-17) version of sqoop2.
Id | Resource | Method | Action/Parameters | ||||
sv1 | /versions version | GET | Return a list of supported protocol versions. Current list includes “1” only. | ||||
sc1 | /v1/connector | GET | Return a brief list of available connectors. | ||||
sc2 | /v1/connector/all | GET | Return a list of connectors with each connector’s metadata. | ||||
sc3 | /v1/connector/cid | GET | Return the metadata of the connector identified by cid | sc4 | /v1/connector/cid | POST | Enable or disable a connector. “ENABLE” → true|false |
sx1 | /v1/connection | GET | Return a brief list of available connections. | ||||
sx2 | /v1/connection/all | GET | Return a list of available connections with metadata about each. | ||||
sx3 | /v1/connection/xid | GET | Return the metadata about connection identified by xid | ||||
sx4 | /v1/connection | POST | Create new connection. “ENABLE” → true|false, Plus connector specific connection metadata | ||||
sx6 | /v1/connection/xid | PUT | Edit Update connection identified by xid. | ||||
sx5 | /v1/connection/xid | DELETE | Delete connection identified by xid. | ||||
sj1 | /v1/job | GET | Return a brief list of available jobs. | ||||
sj2 | /v1/job/all | GET | Return a list of available jobs with their configuration metadata. | ||||
sj3 | /v1/job/jid | GET | Return the metadata about job identified by jid | ||||
sj4 | /v1/job/jid | POST | Create or Edit job. “ENABLE” → true|false, Plus job specific metadata including pre-existing connection. new job. | ||||
sj5 | /v1/job/jid | PUT | Update job identified by jid. | ||||
sj6 sj5 | /v1/job/jid | DELETE | Delete job identified by jid. | ||||
ss1 | /v1/status | GET | List of all jobs that are running | ||||
ss2 | /v1/status/all | GET | List of all jobs that are running with details about each job’s progress | ||||
ss3 | /v1/status/jid | GET | Details of th job identified by jid | ||||
st1 | /v1/jobcontrol | POST | Starts/Stop/Kill a job. “JOBID” → Sqoop specific Job ID | ||||
sn1 | /v1/notification | POST | Notification support for job progress |