microsoft / dstoolkit-mlops-databricks Goto Github PK

Tenant ID had been hard coded in Key Vault Bicep Templates.

Solution: Replace hard coded string with "subscription().tenantId"

My deploys continue to fail in building the clusters with errors like:

HTTPError: 401 Client Error: Unauthorized for url: 
https://adb-3459894219904510.10.azuredatabricks.net/api/2.0/workspace/mkdirs
Error: Process completed with exit code 1

If I try to access that url directly I also get a 401 error logged in as my AD user. BUT, if I go to
https://adb-3459894219904510.10.azuredatabricks.net/ I get the databricks instance page. Both the service principle and my ad user have Owner permissions to the databricks instance.

Is there something I need to do to provision the API?

Concurrent Jobs will initially see no Role, and create it. When creating it, an error will follow if a current job has created the Role in the interim.

Short term fix is to run the pipeline again when it fails (first time).

Long term fix - remove Role Creation from the concurrent pipelines

At present, you can deploy the machine learning scripts from the databricks workflows, or choose to deploy them on the databricks interactive cluster.

The workflows have the python wheel files attached as standard.

However, the python wheel file is not uploaded onto the interactive databricks cluster "ml_cluster"

Upgrade the deployment scripts to include the now supported cluster version (Databricks Runtime 13.3)

Include a selection for Environments in the onDeploy.yml

Deployment fails on the first run with MLFLow Server error.
Problem is remedied with second run (not ideal)

Bug fix is currently in development

Hello, Thanks for providing this accelerator. I am seeing a failure in deploy of BBX workflow artifacts.

Error text:

HTTPError: 401 Client Error: Unauthorized for url: 
https://adb-2652455892987519.19.azuredatabricks.net/api/2.0/workspace/mkdirs

What is the best way for me to debug? I am fairly new to Azure but understand cloud in general. Happy to provide any other details.

I have been trying to debug the API failing due to bad PATs. I just noticed noticed that in all of the databricks resource groups, everything is in US East except the vaults. Is this correct?