Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Status

Current stateProposedIn-progress

Discussion threadhere

JIRA

Motivation

As we see more and more movement to cloud deployments, I believe that we are going to see more demand for users to be able to get their jobs done without the need to ssh into the cluster.

...

Interesting thought to be able to leverage the KnoxShell scripting within the Zeppelin Notebook.
We may be able to combine the session token work described in Section 2 above and KnoxSSO in order to get this to work based on the authenticated user in some way.
This might require another credential collector in order to get it from the interpreter request.

%knoxshell
Hdfs.rm( session ).file( ‘/path/to/dir ).recursive().now().statusCode

4. KnoxShell Improvements

Very specific pain points and improvements are articulated in the following article.

It comes primarily from the context of a general java SDK for Hadoop rather than from a scripting or commandline perspective.

The general usecase is from within a multi-user server side application context.

Each one of the points in this should have a JIRA and be addressed.


5. KnoxShell Tests

Add a testing framework and some example tests for the existing shell functionality. As we add more functionality it is hard to keep up with manual testing.

The proposal here to use the Mini-* (MiniHDFS, MiniKDC etc) testing framework that is used right now for kerberos testing only. We can use a similar setup to test out the shell scripts.