...
- Configuration: Manage system configuration
- Repository Manager:** Create Repository Schema** Create or edit connectors** Create or edit Connections
- Create or edit Jobs
- Connector Manager** Verify connectors** Register new connectors** Edit connectors (enable/disable)
- Job Manager:** Submit new jobs to MR** Get Progress of Jobs from MR** Kill specific job when requested
Initialization
- Configuration** Initialize configuration system
- Initialize logging infrastructure
- Repository Manager** Create repository Schema
- Verify if the schema is accurate
- Connector Manager** Register connectors
- Verify that all connector information is accurate
- Job Manager** Verify the status of jobs that were running at the time of last shutdown
...
- Information needed by the connector to create a connection
- Information needed by the connector to create a job, given a connection
Resources
Green resources are currently implemented in current (2012-10-17) version of sqoop2.
Id | Resource | Method | Action/Parameters | ||
sv1 | /versions version | GET | Return a list of supported protocol versions. Current list includes “1” only. | ||
sc1 | /v1/connector | GET | Return a brief list of available connectors. | ||
sc2 | /v1/connector/all | GET | Return a list of connectors with each connector’s metadata. | ||
sc3 | /v1/connector/cid | GET | Return the metadata of the connector identified by cid sc4 | /v1/connector/cid | |
POST | Enable or disable a connector. “ENABLE” → true|false | sx1 | /v1/connection | GET | Return a brief list of available connections. |
sx2 | /v1/connection/all | GET | Return a list of available connections with metadata about each. | ||
sx3 | /v1/connection/xid | GET | Return the metadata about connection identified by xid | ||
sx4 | /v1/connection | POST | Create new connection. “ENABLE” → true|false, Plus connector specific connection metadata | ||
sx6 | /v1/connection/xid | PUT | Edit Update connection identified by xid. | ||
sx5 | /v1/connection/xid | DELETE | Delete connection identified by xid. | ||
sj1 | /v1/job | GET | Return a brief list of available jobs. | ||
sj2 | /v1/job/all | GET | Return a list of available jobs with their configuration metadata. | ||
sj3 | /v1/job/jid | GET | Return the metadata about job identified by jid | ||
sj4 | /v1/job /jid | POST | Create or Edit job. “ENABLE” → true|false, Plus job specific metadata including pre-existing connection. new job. | ||
sj5 | /v1/job/jid | PUT | Update job identified by jid. | ||
sj6 sj5 | /v1/job/jid | DELETE | Delete job identified by jid. | ||
ss1 | /v1/status | GET | List of all jobs that are running | ||
ss2 | /v1/status/all | GET | List of all jobs that are running with details about each job’s progress | ||
ss3 | /v1/status/jid | GET | Details of th job identified by jid | ||
st1 | /v1/jobcontrol | POST | Starts/Stop/Kill a job. “JOBID” → Sqoop specific Job ID | ||
sn1 | /v1/notification | POST | Notification support for job progress |