...
The sequence diagrams below are intended to be a very detailed description of the interactions that occur during the process of defining, submitting and executing a map reduce job on a secure Hadoop 2.x cluster. Different phases of the overall process are covered in each diagram.
- Bootstrap
- Job Definition
- Job Submission
- Job Initiation
- Map Task Execution
- Reduce Task Execution
- Job Completion
- Client Monitoring
Legend
The descriptions of the interactions in the sequence diagrams below take this form.
...
Abbreviation | Description | ||
---|---|---|---|
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="672eaa6285eb1c1e-8a107fde-485d4987-a53ba219-81e4ac99d2dd8835cc513395"><ac:plain-text-body><![CDATA[ | | Kerberos Protocol | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="f76ae36075a0170d-e244f641-49ac4ceb-aaa0976f-e29ecef4f2c4608ff76d9121"><ac:plain-text-body><![CDATA[ | | RPC protocol with SASL mutual authentication using Kerberos tickets. | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="6b139b8147866b89-cba9d353-470a4b7f-8605adbd-79dd73854fc2efb2054bc14f"><ac:plain-text-body><![CDATA[ | | RPC protocol with SASL mutual authentication using delegation tokens. | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="db5cb0a10626b679-a9e2e9b4-49564dfb-be35b7c2-d1e7b99154916f300b7f78a4"><ac:plain-text-body><![CDATA[ | | RPC protocol with SASL mutual authentication using delegation tokens. | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="bb6b3f18-1fe1-432a-ba66-387121697d5c"><ac:plain-text-body><![CDATA[ | | Shuffle data transfer protocol between ShuffleService and ReduceTask. HTTP protocol with TODO. | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="05d257eb-af83-4a95-ab26-a32ad4e043e6c25457dc-c089-4928-bf94-fd41d50d748a"><ac:plain-text-body><![CDATA[ | | Data Block data transfer protocol between the DataNode and a client. HTTP protocol with block tokens plus SHA1 hash exchange. | ]]></ac:plain-text-body></ac:structured-macro> |
...
Abbreviation | Description | |
---|---|---|
tgt | Kerberos Ticket Granting Ticket kp | |
Kerberos Principal: nn-kp = The Kerberos principal for the NameNode nn | kt | Kerberos Ticket: u-jt-kt = A Kerberos Ticket for User u to access the JobTracker jt |
kp | Kerberos Principal: nn-kp = The Kerberos principal for the NameNode nn | |
dt | Delegation Token: c-nn-dt = A delegation token for identity of the Client that can be presented to the NameNode. | |
tkn | Access Token: am-tkn = An access token that can be presented to the ApplicationMaster for access. | |
tkn-sk | Token Secret Key |
Kerberos principals use the principal abbreviation and the kp suffix.
...