Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Added links to jira, toolkit and server

...

Jira
serverASF JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyATLAS-1696

...

The Governance Action Framework (GAF) is responsible for managing automated governance actions and related activity.  it It provides frameworks and functions to enable enforcement engines, workflows, billing and monitoring tools to use metadata to control the data landscape through metadata.  Examples of the capabilities of the GAF include:

  • Audit logs
  • Exception management
  • Functions to support access control

Most governance actions are happening through execute in external engines and so the GAF is designed to that are working with data and related assets.  The GAF offer embeddable functions and simple APIs to make open metadata easy to integrate.

 

Governance Action Open Metadata Access Service (OMAS)

The Governance Action Open Metadata Access Service provides access to metadata for policy enforcement frameworks such as Apache Ranger.  This API simplifies the internal models and structures of the open metadata type model and related structure for the consumers.

As an example, Ranger needs to know how a particular entity is classified so that the classification can be used within a policy (rule). Atlas has a complex graph oriented model, within which classifications can be multi level - for example a column may be classified  as "employee_salary" whilst employee_salary may be SPI.  Ranger however just needs to know that employee_salary is SPI, not how we got there. So we convert this complex model into something much more operationally focussed and deliver that over the API. The implementation will follow this graph, and build up a list of all tags that are appropriate to use. Note that in the case of Ranger it is actually the tagsync process that will call the GAF for this classification information, .

Ranger can do this today, but via a large number of individual requests to retrieve types & entities. Rather than these lower level queries to Atlas, in GAF we can offer result sets to make queries more efficient, and more appropriate notifications.

Swagger

simplify the implementation of these functions and support metadata-driven operation, whilst being resilient and performant. 

Governance actions themselves produce audit log records and exceptions.  The Governance Action Framework supports the development of stewardship services to analyze audit log records and processes exceptions.  These stewardship services are built using the Open Metadata and Governance Stewardship Toolkit and they run in the Open Metadata and Governance Stewardship Server.

 

...

 A current sketch of the REST API for the Governance Action OMAS can be found at https://app.swaggerhub.com/api/planetf1/GovernanceActionOMAS/0.1 - this is very much work in progress. The explanatory text has some information on the proposed Kafka notifications

...

 

 

 

 

 

 

 

 

...