THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Sub-Systems
- Configuration: Manage system configuration
- Repository Manager:** Create Repository Schema** Create or edit connectors** Create or edit Connections
- Create or edit Jobs
- Connector Manager** Verify connectors** Register new connectors** Edit connectors (enable/disable)
- Job Manager:** Submit new jobs to MR** Get Progress of Jobs from MR** Kill specific job when requested
Initialization
- Configuration** Initialize configuration system
- Initialize logging infrastructure
- Repository Manager** Create repository Schema
- Verify if the schema is accurate
- Connector Manager** Register connectors
- Verify that all connector information is accurate
- Job Manager** Verify the status of jobs that were running at the time of last shutdown
Metadata
Component | Resource | Metadata |
Connector | sc2, sc3 | - Information needed to create connection |
Connection | sx2, sx3 | - Which connector backs this connection |
Job | sj2, sj3 | - Which connection the job is associated with |
Connector Metadata
- Information needed by the connector to create a connection
- Information needed by the connector to create a job, given a connection
Resources
Green resources are currently implemented in current (2012-10-17) version of sqoop2.
...