Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Current state: Work In Progress

Discussion threadhere

JIRA

Motivation

There have been a few motivations for this work. Firstly, while leveraging KnoxShell classes and scripting to test Apache Knox releases, it became obvious that there was no easy way actually test Hive integrations.

...

1 is the blog post that describes this capability.

Another KIP will represent additional KnoxShell improvements regarding KnoxShellTable that will make the use of the JDBC builder much easier and show why this particular usecase may not be required.

I will reference that KIP here once it is written.

UC-6: Custom GroovySh Commands

Groovy shell has exposes the ability to extend the commands available to help automate scripting or coding that you would otherwise need to do programmatically over and over.

...

  • Datasources (:datasource|:ds) CRUD and select operations for a set of JDBC datasources that are persisted to disk (KNOX-2128)
  • SQL (:SQL|:sql) SQL query execution with persisted SQL history per datasource (KNOX-2128)
  • JSON and CSV (:JSON|:json, :CSV|:csv) Import and Export from CSV and JSON formats
  • Table (:Table|:table) General table operations and aggregation/summaries of a table or datasets
  • Mount (:Mount|:mnt) Ability to mount a Knox and topology with metadata describing the exposed UIs, APIs and datasources to a given name from metadata exposed by a Knox API
  • POSIX style filesystem commands for HDFS and cloud storage (:ls, :rm, :mkdir, :chmod, :chown, :cat, :put, etc)

...