Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

(warning) Work in Progress (warning)

Overview

The sequence diagrams below are intended to be a very detailed description of the interactions that occur during the process of defining, submitting and executing a map reduce job on a secure Hadoop 2.x cluster.

...

Abbreviation

Description

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="054d9cc51a86ff1a-032319ac-452a44f4-a26b8ebc-cfc3459ba75eea6e9678865e"><ac:plain-text-body><![CDATA[

[KRB]

Kerberos Protocol

]]></ac:plain-text-body></ac:structured-macro>

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="aad60a3783ce8d75-83b3418b-439a467e-ad12a1e6-fb781ee99e1c7af241cb8ee7"><ac:plain-text-body><![CDATA[

[RSK:{ticket}]

RPC protocol with SASL mutual authentication using Kerberos tickets.

]]></ac:plain-text-body></ac:structured-macro>

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="4263158cd0c061db-40d153bb-4aba4f6b-a2c7b5e9-552ca1a60ded9dcff357303a"><ac:plain-text-body><![CDATA[

[RST:{ticket}]

RPC protocol with SASL mutual authentication using delegation tokens.

]]></ac:plain-text-body></ac:structured-macro>

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="0efac0d42d35edbc-17c02371-42f8470f-852a8287-a707d7360b4715cc9190ef63"><ac:plain-text-body><![CDATA[

[RSD:{delegation-token}]

RPC protocol with SASL mutual authentication using delegation tokens.

]]></ac:plain-text-body></ac:structured-macro>

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="03604010e72af1f6-d72689d2-46314032-8f45b75b-122de0f8097a697f890afaa7"><ac:plain-text-body><![CDATA[

[DTP]

Data transfer protocol between the DataNode and a client. HTTP protocol with block tokens plus SHA1 hash exchange.

]]></ac:plain-text-body></ac:structured-macro>

...

Abbreviation

Description

u-nn-kt

Kerberos service ticket for User u to access NameNode nn

u-jt-kt

Kerberos service ticket for User u to access JobTracker jt

dn-nn-kt

Kerberos service ticket for DataNode dn to access NameNode nn

jt-nn-kt

Kerberos service ticket for JobTracker dn to access NameNode nn

tt-jt-kt

Kerberos service ticket for TaskTracker tt to access JobTracker jt

...

Secure MapReduce2 - Bootstrap

...

Secure MapReduce2 - Job Definition

...

Secure MapReduce2 - Job Submission

...

Secure MapReduce2 - Job Initiation

...

Secure MapReduce2 - Map Task Execution

...

Secure MapReduce2 - Reduce Task Execution

...

Secure MapReduce2 - Job Completion

...

Secure MapReduce2 - Client Monitoring