Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Configuration: Manage system configuration
  • Repository Manager:** Create Repository Schema** Create or edit connectors** Create or edit Connections
    • Create or edit Jobs
  • Connector Manager** Verify connectors** Register new connectors** Edit connectors (enable/disable)
  • Job Manager:** Submit new jobs to MR** Get Progress of Jobs from MR** Kill specific job when requested

Initialization

  • Configuration** Initialize configuration system
    • Initialize logging infrastructure
  • Repository Manager** Create repository Schema
    • Verify if the schema is accurate
  • Connector Manager** Register connectors
    • Verify that all connector information is accurate
  • Job Manager** Verify the status of jobs that were running at the time of last shutdown

...

  • Information needed by the connector to create a connection
  • Information needed by the connector to create a job, given a connection

Resources

Green resources are currently implemented in current (2012-10-17) version of sqoop2.

Id

Resource

Method

Action/Parameters

sv1

/versions version

GET

Return a list of supported protocol versions. Current list includes “1” only.

sc1

/v1/connector

GET

Return a brief list of available connectors.

sc2

/v1/connector/all

GET

Return a list of connectors with each connector’s metadata.

sc3

/v1/connector/cid

GET

Return the metadata of the connector identified by cid sc4

/v1/connector/cid

POST

Enable or disable a connector. “ENABLE” → true|false

sx1

/v1/connection

GET

Return a brief list of available connections.

sx2

/v1/connection/all

GET

Return a list of available connections with metadata about each.

sx3

/v1/connection/xid

GET

Return the metadata about connection identified by xid

sx4

/v1/connection

POST

Create new connection. “ENABLE” → true|false, Plus connector specific connection metadata

sx6

/v1/connection/xid

PUT

Edit Update connection identified by xid.

sx5

/v1/connection/xid

DELETE

Delete connection identified by xid.

sj1

/v1/job

GET

Return a brief list of available jobs.

sj2

/v1/job/all

GET

Return a list of available jobs with their configuration metadata.

sj3

/v1/job/jid

GET

Return the metadata about job identified by jid

sj4

/v1/job /jid

POST

Create or Edit job. “ENABLE” → true|false, Plus job specific metadata including pre-existing connection. new job.

sj5

/v1/job/jid

PUT

Update job identified by jid.

sj6 sj5

/v1/job/jid

DELETE

Delete job identified by jid.

ss1

/v1/status

GET

List of all jobs that are running

ss2

/v1/status/all

GET

List of all jobs that are running with details about each job’s progress

ss3

/v1/status/jid

GET

Details of th job identified by jid

st1

/v1/jobcontrol

POST

Starts/Stop/Kill a job. “JOBID” → Sqoop specific Job ID

sn1

/v1/notification

POST

Notification support for job progress