THIS IS A TEST INSTANCE. ALL YOUR CHANGES WILL BE LOST!!!!
Work in Progress
Overview
The sequence diagrams below are intended to be a very detailed description of the interactions that occur during the process of defining, submitting and executing a map reduce job on a secure Hadoop 2.x cluster.
The descriptions of the interactions below take this form.
message [Protocol] ( input ) : output
The [Protocol] portion describes the protocol, authentication mechanism and identities exchanged.
Abbreviation |
Description |
||
|---|---|---|---|
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="56b5b72b-d624-468e-a0b6-a0c580989db0"><ac:plain-text-body><![CDATA[ |
|
Kerberos Protocol |
]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="9f31453b-6b35-4edd-9ce9-8244371d5fbd"><ac:plain-text-body><![CDATA[ |
|
RPC protocol with SASL mutual authentication using Kerberos tickets. |
]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="032bf9a8-f1d0-4b0b-aaea-dfe2e8d5167e"><ac:plain-text-body><![CDATA[ |
|
RPC protocol with SASL mutual authentication using delegation tokens. |
]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="77c76c79-050c-481d-a07f-f64fc2a62fe5"><ac:plain-text-body><![CDATA[ |
|
RPC protocol with SASL mutual authentication using delegation tokens. |
]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="c1f69261-cc40-428b-9088-2555b10bf1bc"><ac:plain-text-body><![CDATA[ |
|
Data transfer protocol between the DataNode and a client. HTTP protocol with block tokens plus SHA1 hash exchange. |
]]></ac:plain-text-body></ac:structured-macro> |
Suffixes are used in many cases to denote type.
Abbreviation |
Description |
|---|---|
tgt |
Kerberos Ticket Granting Ticket |
kp |
Kerberos Principal: nn-kp = The Kerberos principal for the NameNode nn |
kt |
Kerberos Ticket: u-jt-kt = A Kerberos Ticket for User u to access the JobTracker jt |
sk |
Secret Key |
dt |
Delegation Token |
tkn |
Token |
Kerberos principals use the principal abbreviation and the kp suffix.
Abbreviation |
Description |
|---|---|
|
NameNode's Kerberos Principal |
|
DataNode's Kerberos Principal (Unique principal for each DataNode on every node) |
|
JobTracker's Kerberos Principal |
|
TaskTracker's Kerberos Principal (Unique principal for each TaskTracker on every node) |
Kerberos tickets use the consumer principal abbreviation, provider principal abbreviation and kt suffix.
Abbreviation |
Description |
|---|---|
|
Kerberos service ticket for User u to access NameNode nn |
|
Kerberos service ticket for User u to access JobTracker jt |
|
Kerberos service ticket for DataNode dn to access NameNode nn |
|
Kerberos service ticket for JobTracker dn to access NameNode nn |
|
Kerberos service ticket for TaskTracker tt to access JobTracker jt |
Secure MapReduce2 - Bootstrap
Secure MapReduce2 - Job Definition
Secure MapReduce2 - Job Submission
Secure MapReduce2 - Job Initiation
Secure MapReduce2 - Map Task Execution
Secure MapReduce2 - Reduce Task Execution
Secure MapReduce2 - Job Completion
Secure MapReduce2 - Client Monitoring
