Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For production and larger deployments, we need to be able to accommodate multiple instances of Knox better. My proposal for such cases is a ZooKeeper-based discovery mechanism.
Then, all Knox instances will pick up the changes from ZK as the central source of truth, and perform the necessary generation and deployment of the corresponding topology.

The location of these descriptors and their dependencies (e.g., referenced provider config) must be defined.

It would also be helpful to provide a means by which these descriptors can be easily published to the correct location in a znode.

4. Service Discovery

In order to transform the Simplified Topology Descriptor into a full topology, we need some source for the relevant details and metadata. Knox is often deployed in clusters
with Ambari and ZooKeeper also deployed, and both contain some level of the needed metadata about the service URLs wtihin the cluster.

...