diff --git a/site/docs/connectors/unity-catalog/catalog-survey-service.md b/site/docs/connectors/unity-catalog/catalog-survey-service.md new file mode 100644 index 0000000000..7ad746ce74 --- /dev/null +++ b/site/docs/connectors/unity-catalog/catalog-survey-service.md @@ -0,0 +1,6 @@ + + + +# OSS Unity Catalog Inside Catalog Survey Service + +Survey of a catalog within an OSS Unity Catalog Server. \ No newline at end of file diff --git a/site/docs/connectors/unity-catalog/resource-connector.md b/site/docs/connectors/unity-catalog/resource-connector.md new file mode 100644 index 0000000000..703cf125fb --- /dev/null +++ b/site/docs/connectors/unity-catalog/resource-connector.md @@ -0,0 +1,7 @@ + + + +# OSS Unity Catalog Resource Connector + +The *OSS Unity Catalog resource connector* provides a client wrapper to the Open Source version of Unity Catalog. It aims to provide a buffer to the integration connector and the survey service to protect them from changes to the unity catalog API (which are expected). + diff --git a/site/docs/connectors/unity-catalog/server-survey-service.md b/site/docs/connectors/unity-catalog/server-survey-service.md new file mode 100644 index 0000000000..4975f4d38a --- /dev/null +++ b/site/docs/connectors/unity-catalog/server-survey-service.md @@ -0,0 +1,6 @@ + + + +# OSS Unity Catalog Server Survey Service + +Survey for an instance of the OSS Unity Catalog Server to discover the list of catalogs it is managing. \ No newline at end of file diff --git a/site/docs/connectors/unity-catalog/sync-catalog-connector.md b/site/docs/connectors/unity-catalog/sync-catalog-connector.md new file mode 100644 index 0000000000..927e214fe8 --- /dev/null +++ b/site/docs/connectors/unity-catalog/sync-catalog-connector.md @@ -0,0 +1,4 @@ + + + +# OSS Unity Catalog (UC) Inside a Catalog Synchronizing Connector \ No newline at end of file diff --git a/site/docs/connectors/unity-catalog/sync-server-connector.md b/site/docs/connectors/unity-catalog/sync-server-connector.md new file mode 100644 index 0000000000..5a2b850d3a --- /dev/null +++ b/site/docs/connectors/unity-catalog/sync-server-connector.md @@ -0,0 +1,9 @@ + + + +# OSS Unity Catalog (UC) Server Synchronizing Connector + +The *Unity Catalog OSS Synchronization Connector* exchanges metadata between the open-source version of Unity Catalog and the Open Metadata Ecosystem. + +Its work is scoped by the metadata collection that represents Unity Catalog. This is identified by the *metadataSourceQualifiedName* property in the connector's configuration. +It performs two passes each time it is called. \ No newline at end of file diff --git a/site/docs/connectors/unity-catalog/unity-catalog.drawio b/site/docs/connectors/unity-catalog/unity-catalog.drawio new file mode 100644 index 0000000000..3154cb4588 --- /dev/null +++ b/site/docs/connectors/unity-catalog/unity-catalog.drawio @@ -0,0 +1,879 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/site/docs/types/2/0201-Connectors-and-Connections.svg b/site/docs/types/2/0201-Connectors-and-Connections.svg index aa4bfe738f..d7564c80ca 100644 --- a/site/docs/types/2/0201-Connectors-and-Connections.svg +++ b/site/docs/types/2/0201-Connectors-and-Connections.svg @@ -1,4 +1,4 @@ -
0201 - Connectors and Connections
0201 - Connectors and Connections
«entity»
ConnectorType
«entity»...
0..1
0..1
connections
connections
connectorType
connectorType
*
*
«entity»
Connection
«entity»...
«relationship»
ConnectionConnectorType
«relationship»...
«entity»
Endpoint
«entity»...
*
*
connections
connections
connectionEndpoint
connectionEndpoint
0..1
0..1
«relationship»
ConnectionEndpoint
«relationship»...
displayName : string
description : string
securedProperties : map <string, string>
configurationProperties : map <string, object>
userId : string
clearPassword : string
encryptedPassword : string
displayName : string...
displayName : string
description : string
supportedAssetTypeName : string
deployedImplementationType : string
expectedDataFormat : string
connectorProviderClassName : string
connectorFrameworkName : string
connectorInterfaceLanguage : string
connectorInterfaces : array<string>
targetTechnologySource : string
targetTechnologyName : string
targetTechnologyInterfaces : array<string>
targetTechnologyVersions : array<string>
recognizedAdditionalProperties : array <string>
recognizedSecuredProperties : array <string>
recognizedConfigurationProperties : array <string>
displayName : string...
«entity»
Referenceable
«entity»...
«entity»
ConnectorCategory
«entity»...
displayName : string
description : string
targetTechnologySource : string
targetTechnologyName : string
recognizedAdditionalProperties : map <string, boolean>
recognizedSecuredProperties : map <string, boolean>
recognizedConfigurationProperties : map <string, boolean>
displayName : string...
«relationship»
ConnectorImplementationChoice
«relationship»...
connectorTypes
connectorTypes
connectorCategories
connectorCategories
*
*
*
*
«entity»
Referenceable
«entity»...
«classification»
ConnectorTypeDirectory
«classification»...
«entity»
Collection
«entity»...
Text is not SVG - cannot display
\ No newline at end of file +
0201 - Connectors and Connections
«entity»
ConnectorType
0..1
connections
connectorType
*
«entity»
Connection
«relationship»
ConnectionConnectorType
«entity»
Endpoint
*
connections
connectionEndpoint
0..1
«relationship»
ConnectionEndpoint
displayName : string
description : string
securedProperties : map <string, string>
configurationProperties : map <string, object>
userId : string
clearPassword : string
encryptedPassword : string
displayName : string
description : string
supportedAssetTypeName : string
supportedDeployedImplementationType : string
expectedDataFormat : string
connectorProviderClassName : string
connectorFrameworkName : string
connectorInterfaceLanguage : string
connectorInterfaces : array<string>
targetTechnologySource : string
targetTechnologyName : string
targetTechnologyInterfaces : array<string>
targetTechnologyVersions : array<string>
recognizedAdditionalProperties : array <string>
recognizedSecuredProperties : array <string>
recognizedConfigurationProperties : array <string>
«entity»
Referenceable
«entity»
ConnectorCategory
displayName : string
description : string
targetTechnologySource : string
targetTechnologyName : string
recognizedAdditionalProperties : map <string, boolean>
recognizedSecuredProperties : map <string, boolean>
recognizedConfigurationProperties : map <string, boolean>
«relationship»
ConnectorImplementationChoice
connectorTypes
connectorCategories
*
*
«entity»
Referenceable
«classification»
ConnectorTypeDirectory
«entity»
Collection
\ No newline at end of file diff --git a/site/docs/types/2/area-2-assets.drawio b/site/docs/types/2/area-2-assets.drawio index d5a85b841c..09fc73726f 100644 --- a/site/docs/types/2/area-2-assets.drawio +++ b/site/docs/types/2/area-2-assets.drawio @@ -1,4 +1,4 @@ - + @@ -158,7 +158,7 @@ - + @@ -168,7 +168,7 @@ - + @@ -195,7 +195,7 @@ - + @@ -234,7 +234,7 @@ - + diff --git a/site/docs/types/4/0464-Dynamic-Integration-Groups.svg b/site/docs/types/4/0464-Dynamic-Integration-Groups.svg index 8a256570a3..86123b5b1e 100644 --- a/site/docs/types/4/0464-Dynamic-Integration-Groups.svg +++ b/site/docs/types/4/0464-Dynamic-Integration-Groups.svg @@ -1,4 +1,4 @@ -
0464 - Dynamic Integration Groups
«entity»
SoftwareServerCapability
«entity»
IntegrationConnector
usesBlockingCalls : boolean
«relationship»
RegisteredIntegrationConnector
*
*
connectorName : string
connectorUserId : string
metadataSourceQualifiedName : string
startDate : date
refreshTimeInterval : long
stopDate : date
permittedSynchronization : PermittedSynchronization
supportedIntegrationConnectors
includedInIntegrationGroups
«entity»
DeployedConnector
«entity»
IntegrationGroup
«entity»
OpenMetadataRoot
«relationship»
CatalogTarget
catalogTargetName : string
connectionName : string
configurationProperties : map<string, object>
templates : map<string, string>
metadataSourceQualifiedName : string
*
*
cataloguedByConnectors
catalogTargets
«entity»
OpenMetadataRoot
«entity»
IntegrationReport
serverName : string
connectorId : string
connectorName : string
refreshStartDate : date
refreshCompletionDate : date
createdElements : array<string>
updatedElements : array<string>
deletedElements : array<string>
additionalProperties : map<string, string>
anchorSubject
integrationReports
0..1
*
«relationship»
RelatedIntegrationReport
\ No newline at end of file +
0464 - Dynamic Integration Groups
«entity»
SoftwareServerCapability
«entity»
IntegrationConnector
usesBlockingCalls : boolean
«relationship»
RegisteredIntegrationConnector
*
*
connectorName : string
connectorUserId : string
metadataSourceQualifiedName : string
startDate : date
refreshTimeInterval : long
stopDate : date
permittedSynchronization : PermittedSynchronization
supportedIntegrationConnectors
includedInIntegrationGroups
«entity»
DeployedConnector
«entity»
IntegrationGroup
«entity»
OpenMetadataRoot
«relationship»
CatalogTarget
catalogTargetName : string
connectionName : string
configurationProperties : map<string, object>
templates : map<string, string>
metadataSourceQualifiedName : string
*
*
cataloguedByConnectors
catalogTargets
«entity»
OpenMetadataRoot
«entity»
IntegrationReport
serverName : string
connectorId : string
connectorName : string
refreshStartDate : date
refreshCompletionDate : date
createdElements : array<string>
updatedElements : array<string>
deletedElements : array<string>
additionalProperties : map<string, string>
anchorSubject
integrationReports
0..1
*
«relationship»
RelatedIntegrationReport
\ No newline at end of file diff --git a/site/docs/types/4/area-4-governance.drawio b/site/docs/types/4/area-4-governance.drawio index 2b878c9c58..527f8b5a8b 100644 --- a/site/docs/types/4/area-4-governance.drawio +++ b/site/docs/types/4/area-4-governance.drawio @@ -1,4 +1,4 @@ - + @@ -2553,7 +2553,7 @@ - + @@ -2647,7 +2647,7 @@ - + diff --git a/site/mkdocs.yml b/site/mkdocs.yml index 847e1edadc..0f49d3c6d8 100644 --- a/site/mkdocs.yml +++ b/site/mkdocs.yml @@ -559,6 +559,7 @@ nav: - Notification Manager: services/omvs/notification-manager/overview.md - Project Manager: services/omvs/project-manager/overview.md - Reference Data: services/omvs/reference-data/overview.md + - Runtime Manager: services/omvs/runtime-manager/overview.md - Template Manager: services/omvs/template-manager/overview.md - Valid Metadata: services/omvs/valid-metadata/overview.md - Frameworks: diff --git a/site/snippets/release-notes/5-1.md b/site/snippets/release-notes/5-1.md index 3d552fdab9..b058af8078 100644 --- a/site/snippets/release-notes/5-1.md +++ b/site/snippets/release-notes/5-1.md @@ -5,6 +5,10 @@ _**These are DRAFT release notes. The notes will be updated until & when 5.1 is released**_ +??? functional "Open Metadata Types" + * The [ConnectorType](/types/2/0201-Connectors-and-Connections) entity type has a new attribute called *supportedDeployedImplementationType* which replaces *deployedImplementationType to separate the technology it supports from other uses of *deployedImplementationType* that identify its implementation technology. + * The [CatalogTarget](/types/4/0464-Dynamic-Integration-Groups) relationship is now multi-link which means it is possible to have multiple instances of this relationship between the same two entities. + ??? functional "New View Service: Notification Manager OMVS" [Notification Manager OMVS](/services/omvs/notification-manager/overview) supports the management and querying of [Context Events](/concepts/context-event).