Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Jira
serverASF JIRA
serverId5aa69414-a9e9-3523-82ec-879b028fb15b
keyATLAS-1838

...

...

...

...

 

Area 1 2 of the open metadata model covers the basic types of asset that need to be governed in order to make best use of them.  It builds out the core types of assets, extending from Asset, Infrastructure, DataSet and Process defined in 0010 Base Model.   Figure 1 shows the structure of the model files for area 12.  New classes and packages for this area are coloured colored blue.

 

Image RemovedImage Added

Figure 1: Summary of the Area 1 packages

 

 

Connectors and Connections

In Area 0 we introduced the definitions for a server with an endpoint (model 0040).  The server could host data and APIs.  The Open Connector Framework (OCF) provides client java classes called connectors to enable an application, tool or engine to access this data and other deployed functions.   A Connection metadata entity contains the configuration information to allow the OCF's Connector Broker to select and configure the appropriate a client application or tool to connect to a particular endpoint.  The ConnectorType defines which connector implementation should be used to connect to the endpoint.  The securedProperties holds authentication properties such as userId and password.  They are securely stored to protect the assets.  If they are missing then the security credentials of the current user are used with the connection.

Image RemovedImage Added

Figure 2: Connectors and Connections

 

 

 

...

Connector Directories

Connector directories help to organize the connection definitions into logical groups to help people/tools locate the relevant connections.  They are managed through the Connector Directory OMAS API.

 

Image RemovedImage Added

Figure 3: Organizing connections into connector directories

 

 

 

...

Connection Linkage

The purpose of a connector is to access assets.  In order for the connector to provide metadata about the asset it is accessing, there is a relationship between the connection and the asset.  Notice the connection can only be associated with one asset - however assets may host smaller assets within them.   In addition, some connectors are virtual connectors - by that we mean they implement an abstract to a business level asset and internally use one of more technical connectors as part of their implementation.  The metadata repository can reflect these connection relationships using a VirtualConnection.

 

Image RemovedImage Added

Figure 4: Defining the server capabilities and assets that a connection provides access to

 

 

...

Data Stores

...

The base model introduced the concept of a data set.  The data store definition shows how the data set relates to the server that it is hosted on.  In addition, some data sets are virtual - that is they are build

Image Added

Figure 5: Distinguishing between data set assets and the stores they are located in

 

 

...

 

Data Sets

Figure 6 extends the concept of DataSet to include virtual data sets - that is data sets built up from calling other data sets.  Figure 5 shows the data stores and virtual data sets linking to the data set.

 

Image RemovedImage Added

Figure 5: Distinguishing between data set assets and the stores they are located in

 

6: Virtual Data Sets

 

 

...

Deployed APIs

 

Image RemovedImage Added

Figure 67: Providing remote access to function and data through APIs

 

 

...

 

...

Files and folders

Image Added

Figure 8: Files and folders

 

...

Document Stores

 

Image RemovedImage Added

Figure 79: Metadata Repositories Document Stores

 

...

Graph Stores

 

Files and Folders

Image Added

Figure 10: Graph Stores

 

...

Events and Logs

 

Image Added

Figure 11: Events and Logs

 

...

Databases

Image Added

Figure 12: Database Servers

Image Removed

Figure 8: Definitions for describing files and folders

 

 

 

...

Metadata Repositories

 

Image RemovedImage Added

Figure 9: Specialized stores for managing documents13: Metadata Repositories

 

  

...

Keystores

Databases

Image Added

Figure 14: Secure stores for security information

Image Removed

 

 

...

Applications and Processes

Applications provide business or management logic.  They are often custom built but may also be brought as a package.  They are deployed onto a server.  Some applications are written to support specific processes.  Figure x 15 shows how applications relate to processes and the servers that host them

Image Added

Figure 15: Application and Processes

Image Removed

 

 

 

 

 

...

Data Processing Engines

 

Image Added

Figure 16: Data Processing Engines

 Image Removed

 

 

...