Versions Compared

Old Version 5

changes.mady.by.user Larry McCay

Saved on

compared with

New Version 6

changes.mady.by.user Sumit Gupta

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Interesting thought to be able to leverage the KnoxShell scripting within the Zeppelin Notebook.
We may be able to combine the session token work described in Section 2 above and KnoxSSO in order to get this to work based on the authenticated user in some way.
This might require another credential collector in order to get it from the interpreter request.

%knoxshell
Hdfs.rm( session ).file( ‘/path/to/dir ).recursive().now().statusCode

4. KnoxShell Improvements

Very specific pain points and improvements are articulated in the following article.

It comes primarily from the context of a general java SDK for Hadoop rather than from a scripting or commandline perspective.

The general usecase is from within a multi-user server side application context.

Each one of the points in this should have a JIRA and be addressed.


5. KnoxShell Tests

Add a testing framework and some example tests for the existing shell functionality. As we add more functionality it is hard to keep up with manual testing.

The proposal here to use the Mini-* (MiniHDFS, MiniKDC etc) testing framework that is used right now for kerberos testing only. We can use a similar setup to test out the shell scripts.