azure / purview-samples Goto Github PK

Hello! Thanks for making these documents publicly available. I'm interested in testing the BigQuery connector. I have set up the self-hosted integration and create a service account in GCP. I succesfully configure the BigQuery source and a new Scan in Purview, however the scan hangs as "In progress". Is there any way to debug what is going on? There doesn't appear to be any logged information in the self-hosted integration either.

This repository is currently missing a LICENSE.MD file outlining its license. A license helps users understand how to use your project in a compliant manner. You can find the standard MIT license text at the Microsoft repo templates LICENSE file: https://github.com/microsoft/repo-templates/blob/main/shared/LICENSE.
If you would like to learn more about open source licenses, please visit the document at https://aka.ms/license.

Hi there,
please point me to the right place if this is no the one.

We are trying to load metadata into Purviews Data Catalog via the API (Apache Atlas API) and in our use case there are attributes that reference other types. For example: Company.addresses[] where addresses is an Array of Address type.

The API presents multiple ways to create relationships, but none seem to be able to display the "address" in the list of Company attributes, in the Purview UI.
Basically, we would like to open the Company Entity in the Purview UI and be able to visualize all attributes both primitive types and complex types as the example above.

Any tips are appreciated.
Thanks

VERBOSE: Exception Details - System.TypeInitializationException: The type initializer for
'Microsoft.DataCatalog.Management.Commands.DataFactoryClientManager' threw an exception. --->
System.ArrayTypeMismatchException: Attempted to access an element as a type incompatible with the array.
at System.Collections.Generic.List`1.Add(T item)
at Microsoft.DataCatalog.Management.Commands.Commands.IntegrationRuntimeClient..ctor()
at Microsoft.DataCatalog.Management.Commands.DataFactoryClientManager..cctor()
--- End of inner exception stack trace ---
at Microsoft.DataCatalog.Management.Commands.DataFactoryClientManager.ResetIntegrationRuntimeClient()
at Microsoft.DataCatalog.Management.Commands.SetSessionSettingsCmdlet.ExecuteCmdlet()
at Microsoft.DataCatalog.Management.Commands.DataCatalogCmdletBase.ProcessRecord()
Set-AzDataCatalogSessionSettings : The type initializer for
'Microsoft.DataCatalog.Management.Commands.DataFactoryClientManager' threw an exception.
At line:1 char:1

• Set-AzDataCatalogSessionSettings -TenantId '72f988bf-86f1-41af-91ab-2 ...

•   + CategoryInfo          : NotSpecified: (:) [Set-AzDataCatalogSessionSettings], TypeInitializationException
    + FullyQualifiedErrorId : System.TypeInitializationException,Microsoft.DataCatalog.Management.Commands.SetSessionS
   ettingsCmdlet
  

I'm following this tutorial: https://docs.microsoft.com/en-us/azure/purview/tutorial-scan-data which only gives guidance for Windows users and the files in PurviewStarterKitV4.zip can only be executed within PowerShell. However, will there be a support for MacOS users too? If so, please share the timeline or alternatives in regards to this tutorial.

Thank you!

There are important files that Microsoft projects should all have that are not present in this repository. A pull request has been opened to add the missing file(s). When the pr is merged this issue will be closed automatically.

Microsoft teams can learn more about this effort and share feedback within the open source guidance available internally.

Merge this pull request