Skip to content
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.

Hadoop ecosystem connectors for Egeria: repository proxy connector for Apache Atlas.

License

Notifications You must be signed in to change notification settings

odpi/egeria-connector-hadoop-ecosystem

 
 

Repository files navigation

Egeria Logo

CII Best Practices License Build CodeQL Release Development

Hadoop Ecosystem Repository Connectors

This repository houses the ODPi Egeria connectors for:

  • Apache Atlas connector implements read-only connectivity to the Apache Atlas metadata repository. A Dockerfile is also provided to help you get started with Apache Atlas for demos & testing.

Quick links

  • See the CTS Results for details on its conformance.
  • See the detailed readme configuration instructions, and information on how to test with Atlas using provided Dockerfile & postman collection.

Note the Getting Started guide needs updating so please use the development docs here for now.

How it works

There is currently only an Apache Atlas connector. This connector integrates into the Open Connector Framework (OCF) and implements certain methods that adhere to the interfaces required by a repository proxy. These then communicate with Apache Atlas via Apache Atlas's Java client (in turn communicating via Apache Atlas's REST API) to read information from an Apache Atlas environment.

This requires an existing Apache Atlas environment to already be running elsewhere: the connector simply connects to this existing environment and "proxies" any requests from Egeria into a series of native API calls against the environment.

Overview

Overview of the connector implementation

Limitations

Testing

The connector has only had basic testing performed recently covering

  • Ensure it can connect to Atlas and issue queries
  • Ensure it can receive atlas entity kafka messages & appropriately create entities in Egeria

The environment tested was

  • Egeria 3.15
  • Atlas 'main' (~1 March 2023)

Final note

We are still in the process of re-invigorating this connector. See #464 for further information.

There has been no 'release' for a long time. If interested get in touch, as we now know the connector does still work with the current Egeria releases, but there are limitations (Mar 2023)

Go to the main Egeria site


License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.