License: MIT License

PowerShell 100.00%

powerbi-azure-pipelines-extensions's Introduction

Power BI automation tools for Azure DevOps
Automate release management tasks related to Power BI deployment pipelines
Install now!

Power BI automation tools for Azure DevOps

The Power BI deployment pipelines tool enables BI teams to build an efficient and reusable release process for their Power BI content. You can leverage the tasks in this Azure DevOps extension to integrate Power BI into your organization's automation process. Here are a few examples of what can be done using these extension:

Manage Power BI pipelines from start to finish, including creating a pipeline, assigning a workspace to any stage, deploying and deleting the pipeline.
Assign users to a pipeline.
Assign users to a workspace.
Deploy all/selected items in a Power BI pipeline to the next stage.

Build

You can use the build.ps1 script to build and package the extesnion.

If you are forking this Repo make sure to update the dev.json.

.\build.ps1

after building for the first time, you can use the following command to skip installing powrshell modules and reduce build time:

.\build.ps1 -SkipModules

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Trademarks

This project may contain trademarks or logos for projects, products, or services. Authorized use of Microsoft trademarks or logos is subject to and must follow Microsoft's Trademark & Brand Guidelines. Use of Microsoft trademarks or logos in modified versions of this project must not cause confusion or imply Microsoft sponsorship. Any use of third-party trademarks or logos are subject to those third-party's policies.

powerbi-azure-pipelines-extensions's People

Contributors

Stargazers

Watchers

Forkers

hajicirruslabs isantillan1 ievsantillan bronx205 angelcanto test-mass-forker-org-1 johnl4 pabrams seanpm2001 philguth annmalbojke gschuurman yorickbouma

powerbi-azure-pipelines-extensions's Issues

Does this extension allow you to change the data source from one workspace to another ?

“Response status code does not indicate success: 400 (Bad Request).”

While adding a user to workspace in power BI using "Add a user to workspace" task I am getting an error “Response status code does not indicate success: 400 (Bad Request).” Can anyone please tell me how to resolve it.

Adding Dataset Parameters Replacements as Action

Integrating an action to replace a specific dataset parameter value within thisextension would be great, since we could manage dataset source parameters such as the database connection detail centralized in DevOps libraries.

It is basically an integration of this extension:
https://marketplace.visualstudio.com/items?itemName=AliMostafa.set-power-bi-dataset-parameters&ssr=false#overview

Deploy content in a deployment pipeline - failing

I've configured Deploy content in a deployment pipeline (please see attached image_ but it is failing while deploying

I've applied all the permission correctly and pipeline name is also correct but not sure why it is failing and it seems like It is not looking for correct org but looking at myorg.

Deploy content to the Test stage : Error 400

Hello,

When I try to deploy, I get a 400 error every time.

I have tried different names for the new workspace though.

But nothing works

Deploy Contents not working All / Selective

I think this should be an active issue. I'm on the right version, got the correct Azure AD app permissions/Service Principal setup, Group, Enabled Service Principals in Power BI Service. Work fine for creating pipeline, assigning a workspace to any stage, deleting pipeline, assigning users to pipeline, assigning users to a workspace (So there is connectivity). But it FAILS to deploy all OR selective content in a power BI pipeline to the next stage as it either returns a Status 400 Bad request OR it cannot find the artifacts to deploy.

Not truly updating .pbix - Generating new URL

This extension appears to be generating a new URL for reports, even when the file is named identically to an existing report. This obviously renders the existing URL useless.

Is this behavior expected?

build.ps1 expects tfx to exist

When I execute build.ps1 it seems to expect tfx-cli already is installed:

tfx : The term 'tfx' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the
spelling of the name, or if a path was included, verify that the path is correct and try again.
At C:\powerbi-azure-pipelines-extensions\build.ps1:39 char:1

tfx extension create --overrides-file $ovverides --rev-version $Updat ...

  + CategoryInfo          : ObjectNotFound: (tfx:String) [], CommandNotFoundException
  + FullyQualifiedErrorId : CommandNotFoundException

Please Add option to add User Group to Deployment pipeline and workspace

Please Add option to add User Group to Deployment pipeline and workspace,

This is the same as the current call but with a different Type.

Data Source Connection Not Working

Hi,

I've been trying to deploy reports from Azure DevOps in to our workspaces.
We have created the relevant service connections with a Machine User.
In Dev, we deploy the PBIX files kept on Azure Repos using a third Party task in our Build pipeline. We are using Directquery mode and SSO Authentication Mode to our Data Source (Azure Synapse, Dedicated Pool).

For deployment to QA and PROD, we are using "Deployment Pipeline" module but we interact with it using this "Power BI Automation Tools" in our Release Pipelines.

Now the reports are getting deployed, so there is no error in the execution logs which I can mention here.

The problem is when we try to access these reports, we are displayed this message:
The Data Source is missing Credentials and cannot be accessed.

I checked, The owner of the deployed dataset is the Machine User used in Service Connection. This Machine User has Power BI Pro License, all relevant access - on the Data Source (Synapse Dedicated SQL Pool), Deployment Pipeline, The Power BI Workspace.
Even though that should not matter, since the report is deployed with - "Use End-user's own credentials to access underlying data."

Anyway, as soon as I just take over this deployed report (not doing anything else), the report starts showing up data and the error is gone. I'm not able to understand this behavior.

Please help as we plan to deploy our reports in Production using automation and can't seem to find any working way for this!

I can provide more details in a call if we can facilitate it. I also have a Azure DevOps support ticket created for this: 2208290050000527.

Option for calling Pipelines_Deploy from Stage 0 ('Development') to Stage 2 ('Production')

The Pipelines_Deploy task does currently not allow for deployment of artifacts from Development to Production stage. This functionality should be added in case the PowerBI Pipeline setup does not have a Test stage, but Development and Production stages only.

Selective Deployment keeps calling DeployAll API

Deploy content In a Deployment Pipeline task keeps calling DeployAll API as seen on logs.

Sample configuration

Logs and testing show it will still perform DeployAll instead of Selective - https://docs.microsoft.com/en-us/rest/api/power-bi/pipelines/selective-deploy

Deploy Pipeline Error - A task was canceled.

Attempting to deployAll content to a workspace is failing with "A task was canceled." error message. I was able to replicate the error using the REST APIs. The solution is to set the -TimeoutSec of the Invoke-PowerBIRestMethod call to a higher value. This can be done manually, but not in the extension.

Log:
2022-08-09T12:19:25.4400781Z ##[debug]Evaluating condition for step: 'Copy content from Test'
2022-08-09T12:19:25.4402987Z ##[debug]Evaluating: succeeded()
2022-08-09T12:19:25.4403513Z ##[debug]Evaluating succeeded:
2022-08-09T12:19:25.4404754Z ##[debug]=> True
2022-08-09T12:19:25.4405343Z ##[debug]Result: True
2022-08-09T12:19:25.4405809Z ##[section]Starting: Copy content from Test
2022-08-09T12:19:25.4531266Z ==============================================================================
2022-08-09T12:19:25.4531645Z Task : Deploy content in a deployment pipeline
2022-08-09T12:19:25.4531953Z Description : Deploy content in a Power BI deployment pipeline
2022-08-09T12:19:25.4532256Z Version : 1.0.10
2022-08-09T12:19:25.4532446Z Author : Microsoft
2022-08-09T12:19:25.4533332Z Help :
2022-08-09T12:19:25.4533588Z ==============================================================================
2022-08-09T12:19:27.1192197Z ##[debug]VstsTaskSdk 0.11.0 commit 7ff27a3e0bdd6f7b06690ae5f5b63cb84d0f23f4
2022-08-09T12:19:27.3203942Z ##[debug]INPUT_PBICONNECTION: '7ab44a8d-505f-458f-9c88-882b692eb92c'
2022-08-09T12:19:27.3326430Z ##[debug]ENDPOINT_URL_7ab44a8d-505f-458f-9c88-882b692eb92c: 'https://api.powerbi.com/'
2022-08-09T12:19:27.3407708Z ##[debug]ENDPOINT_AUTH_7ab44a8d-505f-458f-9c88-882b692eb92c: '********'
2022-08-09T12:19:27.3408813Z ##[debug]ENDPOINT_DATA_7ab44a8d-505f-458f-9c88-882b692eb92c: '{"Environment":"Public"}'
2022-08-09T12:19:27.3411351Z ##[debug]INPUT_PIPELINE: 'LA - PBI Profiles Pipeline'
2022-08-09T12:19:27.3436232Z ##[debug]INPUT_STAGEORDER: 'Production'
2022-08-09T12:19:27.3464134Z ##[debug]INPUT_WAITFORCOMPLETION: 'true'
2022-08-09T12:19:27.3531541Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3532691Z ##[debug]INPUT_DEPLOYTYPE: 'All'
2022-08-09T12:19:27.3548263Z ##[debug]INPUT_DATAFLOWS (empty)
2022-08-09T12:19:27.3600026Z ##[debug]INPUT_DATASETS (empty)
2022-08-09T12:19:27.3626712Z ##[debug]INPUT_REPORTS (empty)
2022-08-09T12:19:27.3650066Z ##[debug]INPUT_DAHSBOARDS (empty)
2022-08-09T12:19:27.3678058Z ##[debug]INPUT_CREATENEWWS: 'false'
2022-08-09T12:19:27.3696410Z ##[debug] Converted to bool: False
2022-08-09T12:19:27.3723671Z ##[debug]INPUT_NEWWSNAME: 'LA - PBI Profiles (Production)'
2022-08-09T12:19:27.3747206Z ##[debug]INPUT_CAPACITY (empty)
2022-08-09T12:19:27.3775124Z ##[debug]INPUT_ALLOWCREATEARTIFACT: 'true'
2022-08-09T12:19:27.3794412Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3819812Z ##[debug]INPUT_ALLOWOVERWRITEARTIFACT: 'true'
2022-08-09T12:19:27.3838278Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3862551Z ##[debug]INPUT_ALLOWOVERWRITETARGETARTIFACTLABEL: 'true'
2022-08-09T12:19:27.3881331Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3905154Z ##[debug]INPUT_ALLOWPURGEDATA: 'true'
2022-08-09T12:19:27.3923588Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3947774Z ##[debug]INPUT_ALLOWSKIPTILESWITHMISSINGPREREQUISITES: 'true'
2022-08-09T12:19:27.3966687Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.3991248Z ##[debug]INPUT_ALLOWTAKEOVER: 'true'
2022-08-09T12:19:27.4009469Z ##[debug] Converted to bool: True
2022-08-09T12:19:27.4033774Z ##[debug]INPUT_UPDATEAPP: 'false'
2022-08-09T12:19:27.4052102Z ##[debug] Converted to bool: False
2022-08-09T12:19:27.4117647Z Importing module MicrosoftPowerBIMgmt.Profile
2022-08-09T12:19:27.5229916Z ##[debug]Loading module from path 'D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\ps_modules\MicrosoftPowerBIMgmt.Profile\MicrosoftPowerBIMgmt.Profile.psd1'.
2022-08-09T12:19:27.5238019Z ##[debug]Loading 'TypesToProcess' from path 'D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\ps_modules\MicrosoftPowerBIMgmt.Profile\Microsoft.PowerBI.Commands.Profile.types.ps1xml'.
2022-08-09T12:19:27.5266159Z ##[debug]Loading 'FormatsToProcess' from path 'D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\ps_modules\MicrosoftPowerBIMgmt.Profile\Microsoft.PowerBI.Commands.Profile.format.ps1xml'.
2022-08-09T12:19:27.5661744Z ##[debug]Populating RepositorySourceLocation property for module MicrosoftPowerBIMgmt.Profile.
2022-08-09T12:19:27.5695806Z ##[debug]Loading module from path 'D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\ps_modules\MicrosoftPowerBIMgmt.Profile.\lib\netstandard2.0\Microsoft.PowerBI.Commands.Profile.dll'.
2022-08-09T12:19:27.5828520Z ##[debug]Exporting cmdlet 'Connect-PowerBIServiceAccount'.
2022-08-09T12:19:27.5845627Z ##[debug]Exporting cmdlet 'Disconnect-PowerBIServiceAccount'.
2022-08-09T12:19:27.5861825Z ##[debug]Exporting cmdlet 'Get-PowerBIAccessToken'.
2022-08-09T12:19:27.5880602Z ##[debug]Exporting cmdlet 'Invoke-PowerBIRestMethod'.
2022-08-09T12:19:27.5897668Z ##[debug]Exporting cmdlet 'Resolve-PowerBIError'.
2022-08-09T12:19:27.5915538Z ##[debug]Importing cmdlet 'Connect-PowerBIServiceAccount'.
2022-08-09T12:19:27.5931889Z ##[debug]Importing cmdlet 'Disconnect-PowerBIServiceAccount'.
2022-08-09T12:19:27.5950252Z ##[debug]Importing cmdlet 'Get-PowerBIAccessToken'.
2022-08-09T12:19:27.5967446Z ##[debug]Importing cmdlet 'Invoke-PowerBIRestMethod'.
2022-08-09T12:19:27.5985193Z ##[debug]Importing cmdlet 'Resolve-PowerBIError'.
2022-08-09T12:19:27.6001616Z ##[debug]Importing alias 'Add-PowerBIServiceAccount'.
2022-08-09T12:19:27.6020011Z ##[debug]Importing alias 'Login-PowerBI'.
2022-08-09T12:19:27.6036277Z ##[debug]Importing alias 'Login-PowerBIServiceAccount'.
2022-08-09T12:19:27.6054010Z ##[debug]Importing alias 'Logout-PowerBI'.
2022-08-09T12:19:27.6070783Z ##[debug]Importing alias 'Logout-PowerBIServiceAccount'.
2022-08-09T12:19:27.6087410Z ##[debug]Importing alias 'Remove-PowerBIServiceAccount'.
2022-08-09T12:19:27.6103651Z ##[debug]Importing alias 'Set-PowerBIServiceAccount'.
2022-08-09T12:19:27.6209031Z Connecting to Power BI with ServicePrincipal
2022-08-09T12:19:28.2542156Z ##[debug]12:19:28 PM - Connect-PowerBIServiceAccount begin processing with ParameterSet ServicePrincipal.
2022-08-09T12:19:28.2563456Z ##[debug]12:19:28 PM - Cmdlet version: 1.2.1077.0
2022-08-09T12:19:28.3083622Z ##[debug]Updated Azure AD authority with -Tenant specified, new value: https://login.microsoftonline.com/96ed3503-a854-4aeb-ab8c-56b685f399c1
2022-08-09T12:19:28.4645254Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28] Found 0 cache accounts and 0 broker accounts
2022-08-09T12:19:28.4714842Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] MSAL MSAL.Desktop with assembly version '4.25.0.0'. CorrelationId(35b94087-d97f-4a4d-9144-9cc52f80c65e)
2022-08-09T12:19:28.4747678Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] === AcquireTokenForClientParameters ===
2022-08-09T12:19:28.4758817Z ##[debug]SendX5C: False
2022-08-09T12:19:28.4770540Z ##[debug]WithAzureRegion: False
2022-08-09T12:19:28.4782805Z ##[debug]RegionToUse:
2022-08-09T12:19:28.4794585Z ##[debug]ForceRefresh: False
2022-08-09T12:19:28.4806363Z ##[debug]
2022-08-09T12:19:28.4936486Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e]
2022-08-09T12:19:28.4948050Z ##[debug]=== Request Data ===
2022-08-09T12:19:28.4959853Z ##[debug]Authority Provided? - True
2022-08-09T12:19:28.4971679Z ##[debug]Scopes - https://analysis.windows.net/powerbi/api/.default
2022-08-09T12:19:28.4983152Z ##[debug]Extra Query Params Keys (space separated) -
2022-08-09T12:19:28.4994411Z ##[debug]ApiId - AcquireTokenForClient
2022-08-09T12:19:28.5005963Z ##[debug]IsConfidentialClient - True
2022-08-09T12:19:28.5017660Z ##[debug]SendX5C - False
2022-08-09T12:19:28.5029290Z ##[debug]LoginHint ? False
2022-08-09T12:19:28.5040712Z ##[debug]IsBrokerConfigured - False
2022-08-09T12:19:28.5051618Z ##[debug]HomeAccountId - False
2022-08-09T12:19:28.5063346Z ##[debug]CorrelationId - 35b94087-d97f-4a4d-9144-9cc52f80c65e
2022-08-09T12:19:28.5075323Z ##[debug]
2022-08-09T12:19:28.5103879Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] === Token Acquisition (ClientCredentialRequest) started:
2022-08-09T12:19:28.5115181Z ##[debug]
2022-08-09T12:19:28.5127428Z ##[debug] Authority Host: login.microsoftonline.com
2022-08-09T12:19:28.5462601Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Fetching instance discovery from the network from host login.microsoftonline.com.
2022-08-09T12:19:29.0885763Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:28 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Resolving authority endpoints... Already resolved? - FALSE
2022-08-09T12:19:29.0904030Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] ScopeSet was missing from the token response, so using developer provided scopes in the result.
2022-08-09T12:19:29.0921239Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Checking client info returned from the server..
2022-08-09T12:19:29.0937856Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Saving Token Response to cache..
2022-08-09T12:19:29.0954108Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] ID Token not present in response.
2022-08-09T12:19:29.0998173Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Saving AT in cache and removing overlapping ATs...
2022-08-09T12:19:29.1000475Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Looking for scopes for the authority in the cache which intersect with https://analysis.windows.net/powerbi/api/.default
2022-08-09T12:19:29.1011461Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] Intersecting scope entries count - 0
2022-08-09T12:19:29.1021810Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 35b94087-d97f-4a4d-9144-9cc52f80c65e] === Token Acquisition finished successfully. An access token was returned with Expiration Time: 08/09/2022 13:19:28 +00:00 ===
2022-08-09T12:19:29.1040014Z ##[debug]12:19:29 PM - Connect-PowerBIServiceAccount end processing.
2022-08-09T12:19:29.1165120Z Activity ID: b340188f-dc4b-4396-992f-7d008dbac242
2022-08-09T12:19:29.1171943Z Getting pipeline
2022-08-09T12:19:29.2010548Z ##[debug]12:19:29 PM - Invoke-PowerBIRestMethod begin processing with ParameterSet __AllParameterSets.
2022-08-09T12:19:29.2028790Z ##[debug]12:19:29 PM - Cmdlet version: 1.2.1077.0
2022-08-09T12:19:29.2176487Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29] Found 0 cache accounts and 0 broker accounts
2022-08-09T12:19:29.2194951Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901] MSAL MSAL.Desktop with assembly version '4.25.0.0'. CorrelationId(2ae1ae54-1aa0-4ea3-9671-b4dc57826901)
2022-08-09T12:19:29.2212670Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901] === AcquireTokenForClientParameters ===
2022-08-09T12:19:29.2224019Z ##[debug]SendX5C: False
2022-08-09T12:19:29.2235679Z ##[debug]WithAzureRegion: False
2022-08-09T12:19:29.2246904Z ##[debug]RegionToUse:
2022-08-09T12:19:29.2258639Z ##[debug]ForceRefresh: False
2022-08-09T12:19:29.2269870Z ##[debug]
2022-08-09T12:19:29.2288323Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901]
2022-08-09T12:19:29.2299745Z ##[debug]=== Request Data ===
2022-08-09T12:19:29.2311294Z ##[debug]Authority Provided? - True
2022-08-09T12:19:29.2322785Z ##[debug]Scopes - https://analysis.windows.net/powerbi/api/.default
2022-08-09T12:19:29.2334388Z ##[debug]Extra Query Params Keys (space separated) -
2022-08-09T12:19:29.2345573Z ##[debug]ApiId - AcquireTokenForClient
2022-08-09T12:19:29.2357101Z ##[debug]IsConfidentialClient - True
2022-08-09T12:19:29.2368383Z ##[debug]SendX5C - False
2022-08-09T12:19:29.2378936Z ##[debug]LoginHint ? False
2022-08-09T12:19:29.2390649Z ##[debug]IsBrokerConfigured - False
2022-08-09T12:19:29.2401851Z ##[debug]HomeAccountId - False
2022-08-09T12:19:29.2413453Z ##[debug]CorrelationId - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901
2022-08-09T12:19:29.2424450Z ##[debug]
2022-08-09T12:19:29.2441958Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901] === Token Acquisition (ClientCredentialRequest) started:
2022-08-09T12:19:29.2452692Z ##[debug]
2022-08-09T12:19:29.2464359Z ##[debug] Authority Host: login.microsoftonline.com
2022-08-09T12:19:29.2518712Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901] Access token is not expired. Returning the found cache entry. [Current time (08/09/2022 12:19:29) - Expiration Time (08/09/2022 13:19:28 +00:00) - Extended Expiration Time (08/09/2022 13:19:28 +00:00)]
2022-08-09T12:19:29.2544481Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 2ae1ae54-1aa0-4ea3-9671-b4dc57826901] === Token Acquisition finished successfully. An access token was returned with Expiration Time: 08/09/2022 13:19:28 +00:00 ===
2022-08-09T12:19:29.4365952Z ##[debug]Request Uri: https://api.powerbi.com/v1.0/myorg/pipelines
2022-08-09T12:19:29.4385390Z ##[debug]Status Code: OK (200)
2022-08-09T12:19:29.4404353Z ##[debug]12:19:29 PM - Invoke-PowerBIRestMethod end processing.
2022-08-09T12:19:29.4921199Z Sending request to start deployment - pipelines/70dd9f3c-f879-42b3-b816-3458a580a6c1/DeployAll
2022-08-09T12:19:29.4944656Z Request Body- {
2022-08-09T12:19:29.4945051Z "isBackwardDeployment": false,
2022-08-09T12:19:29.4945707Z "sourceStageOrder": 1,
2022-08-09T12:19:29.4946147Z "options": {
2022-08-09T12:19:29.4946578Z "allowTakeOver": true,
2022-08-09T12:19:29.4947042Z "allowOverwriteArtifact": true,
2022-08-09T12:19:29.4947491Z "allowPurgeData": true,
2022-08-09T12:19:29.4948080Z "allowSkipTilesWithMissingPrerequisites": true,
2022-08-09T12:19:29.4948592Z "allowCreateArtifact": true,
2022-08-09T12:19:29.4949089Z "allowOverwriteTargetArtifactLabel": true
2022-08-09T12:19:29.4949517Z }
2022-08-09T12:19:29.4949854Z }
2022-08-09T12:19:29.4975218Z ##[debug]12:19:29 PM - Invoke-PowerBIRestMethod begin processing with ParameterSet __AllParameterSets.
2022-08-09T12:19:29.4992522Z ##[debug]12:19:29 PM - Cmdlet version: 1.2.1077.0
2022-08-09T12:19:29.5013225Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29] Found 0 cache accounts and 0 broker accounts
2022-08-09T12:19:29.5030407Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae] MSAL MSAL.Desktop with assembly version '4.25.0.0'. CorrelationId(1d26956e-0308-4e33-b27e-81587bf93cae)
2022-08-09T12:19:29.5046940Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae] === AcquireTokenForClientParameters ===
2022-08-09T12:19:29.5058240Z ##[debug]SendX5C: False
2022-08-09T12:19:29.5069772Z ##[debug]WithAzureRegion: False
2022-08-09T12:19:29.5081366Z ##[debug]RegionToUse:
2022-08-09T12:19:29.5092769Z ##[debug]ForceRefresh: False
2022-08-09T12:19:29.5104066Z ##[debug]
2022-08-09T12:19:29.5580437Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae]
2022-08-09T12:19:29.5592831Z ##[debug]=== Request Data ===
2022-08-09T12:19:29.5606233Z ##[debug]Authority Provided? - True
2022-08-09T12:19:29.5619504Z ##[debug]Scopes - https://analysis.windows.net/powerbi/api/.default
2022-08-09T12:19:29.5630731Z ##[debug]Extra Query Params Keys (space separated) -
2022-08-09T12:19:29.5643188Z ##[debug]ApiId - AcquireTokenForClient
2022-08-09T12:19:29.5655363Z ##[debug]IsConfidentialClient - True
2022-08-09T12:19:29.5669136Z ##[debug]SendX5C - False
2022-08-09T12:19:29.5677416Z ##[debug]LoginHint ? False
2022-08-09T12:19:29.5689772Z ##[debug]IsBrokerConfigured - False
2022-08-09T12:19:29.5701288Z ##[debug]HomeAccountId - False
2022-08-09T12:19:29.5713652Z ##[debug]CorrelationId - 1d26956e-0308-4e33-b27e-81587bf93cae
2022-08-09T12:19:29.5724826Z ##[debug]
2022-08-09T12:19:29.5741973Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae] === Token Acquisition (ClientCredentialRequest) started:
2022-08-09T12:19:29.5752942Z ##[debug]
2022-08-09T12:19:29.5764469Z ##[debug] Authority Host: login.microsoftonline.com
2022-08-09T12:19:29.5782520Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae] Access token is not expired. Returning the found cache entry. [Current time (08/09/2022 12:19:29) - Expiration Time (08/09/2022 13:19:28 +00:00) - Extended Expiration Time (08/09/2022 13:19:28 +00:00)]
2022-08-09T12:19:29.5803856Z ##debug MSAL 4.25.0.0 MSAL.Desktop Microsoft Windows NT 10.0.17763.0 [08/09/2022 12:19:29 - 1d26956e-0308-4e33-b27e-81587bf93cae] === Token Acquisition finished successfully. An access token was returned with Expiration Time: 08/09/2022 13:19:28 +00:00 ===
2022-08-09T12:21:09.6939594Z ##[debug]12:21:09 PM - Resolve-PowerBIError begin processing with ParameterSet LastError.
2022-08-09T12:21:09.6958827Z ##[debug]12:21:09 PM - Cmdlet version: 1.2.1077.0
2022-08-09T12:21:09.7120368Z ##[debug]12:21:09 PM - Resolve-PowerBIError end processing.
2022-08-09T12:21:09.7471450Z ##[debug]Caught exception from task script.
2022-08-09T12:21:09.7501210Z ##[debug]Error record:
2022-08-09T12:21:09.8071086Z ##[debug]D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\Run.ps1 : A task was canceled.
2022-08-09T12:21:09.8084285Z ##[debug]At line:1 char:1
2022-08-09T12:21:09.8096448Z ##[debug]+ . 'D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301 ...
2022-08-09T12:21:09.8108336Z ##[debug]+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
2022-08-09T12:21:09.8120001Z ##[debug] + CategoryInfo : NotSpecified: (:) [Write-Error], WriteErrorException
2022-08-09T12:21:09.8131719Z ##[debug] + FullyQualifiedErrorId : Microsoft.PowerShell.Commands.WriteErrorException,Run.ps1
2022-08-09T12:21:09.8142982Z ##[debug]
2022-08-09T12:21:09.8162445Z ##[debug]Script stack trace:
2022-08-09T12:21:09.8197190Z ##[debug]at , D:\a_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.0.10\Run.ps1: line 141
2022-08-09T12:21:09.8208752Z ##[debug]at , : line 1
2022-08-09T12:21:09.8220572Z ##[debug]at , : line 22
2022-08-09T12:21:09.8231959Z ##[debug]at , : line 18
2022-08-09T12:21:09.8243713Z ##[debug]at , : line 1
2022-08-09T12:21:09.8261125Z ##[debug]Exception:
2022-08-09T12:21:09.8299808Z ##[debug]Microsoft.PowerShell.Commands.WriteErrorException: A task was canceled.
2022-08-09T12:21:09.8536220Z ##[error]A task was canceled.
2022-08-09T12:21:09.8545974Z ##[debug]Processed: ##vso[task.logissue type=error]A task was canceled.
2022-08-09T12:21:09.8548568Z ##[debug]Processed: ##vso[task.complete result=Failed]
2022-08-09T12:21:09.8959470Z ##[section]Finishing: Copy content from Test

Penetration Test Results available?

We want to use your extension in our Azure DevOps, but for security reasons we were asked to provide Penetration Test Results as the process needs enhanced AAD permissions like Tenant.Read.All or Tenant.ReadWrite.All. Were such tests executed and can we get them?

Power BI Automation (tools): "This extension is not installable on any currently installed products."

The download is not working. We believe we have the necessary installations (Report Builder, Desktop). Is there something else we need installed before this download to be able to use the extension?
dd_VSIXInstaller_20220616145303_46f0.log

Thanks,
Mike Mc

Publish action throwing powershell issue

Hi,
I'm publishing .pbix files to workspace via azure devops using Service principal. In the publish task, I'm running into below issue. Could you please help in addressing this issue?

##[debug]received -1-byte response of content type application/json; odata.metadata=minimal; odata.streaming=true ##[debug]7:25:39 AM - Resolve-PowerBIError begin processing with ParameterSet LastError. ##[debug]7:25:39 AM - Cmdlet version: 1.2.1093.0 ##[debug]7:25:39 AM - Resolve-PowerBIError end processing. ##[debug]Caught exception from task script. ##[debug]Error record: ##[debug]Start-PipelineDeployment : The property 'options' cannot be found on this object. Verify that the property exists and can be set. ##[debug]At D:\a\_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.2.0\Run.ps1:25 char:1 ##[debug]+ Start-PipelineDeployment -ActivityId $activityId -Endpoint $endpoint ... ##[debug]+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ##[debug] + CategoryInfo : NotSpecified: (:) [Write-Error], WriteErrorException ##[debug] + FullyQualifiedErrorId : Microsoft.PowerShell.Commands.WriteErrorException,Start-PipelineDeployment ##[debug] ##[debug]Script stack trace: ##[debug]at Start-PipelineDeployment, D:\a\_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.2.0\ps_modules\PowerBIApiUtils\PowerBIApiUtils.psm1: line 475 ##[debug]at <ScriptBlock>, D:\a\_tasks\DeploymentPipelines-Deploy_387b9cad-cfe0-4502-b150-301f8942e8b7\1.2.0\Run.ps1: line 25 ##[debug]at <ScriptBlock>, <No file>: line 1 ##[debug]at <ScriptBlock>, <No file>: line 22 ##[debug]at <ScriptBlock>, <No file>: line 18 ##[debug]at <ScriptBlock>, <No file>: line 1 ##[debug]Exception: ##[debug]Microsoft.PowerShell.Commands.WriteErrorException: The property 'options' cannot be found on this object. Verify that the property exists and can be set. ##[error]**The property 'options' cannot be found on this object. Verify that the property exists and can be set.** ##[debug]Processed: ##vso[task.logissue type=error]The property 'options' cannot be found on this object. Verify that the property exists and can be set. ##[debug]Processed: ##vso[task.complete result=Failed]

Trying to connect power BI workspace from azure devops deployment pipelines

Hi Team,

we are using Power BI automation tools extension to connect to power BI workspace.

we are trying to connect power BI workspace from azure devops using service prinicipal authentication. we were getting below error when we try to hit the power BI workspace.
Could you please take a look at below issue.
Error Details from Logs:
5597144Z ##[error]Response status code does not indicate success: 400 (Bad Request).

Full Log details pipeline:
2022-03-03T15:15:39.8615538Z ##[section]Starting: Deploy content to the Test stage
2022-03-03T15:15:40.0076320Z ==============================================================================
2022-03-03T15:15:40.0076968Z Task : Deploy content in a deployment pipeline
2022-03-03T15:15:40.0077432Z Description : Deploy content in a Power BI deployment pipeline
2022-03-03T15:15:40.0077702Z Version : 1.0.10
2022-03-03T15:15:40.0078023Z Author : Microsoft
2022-03-03T15:15:40.0078408Z Help :
2022-03-03T15:15:40.0078678Z ==============================================================================
2022-03-03T15:15:43.3671665Z Importing module MicrosoftPowerBIMgmt.Profile
2022-03-03T15:15:43.4064949Z Connecting to Power BI with ServicePrincipal
2022-03-03T15:15:44.4822569Z Activity ID: ffe071e6-8200-4bc6-bb22-5ecb9e87f8b7
2022-03-03T15:15:44.4830107Z Getting pipeline
2022-03-03T15:15:44.9275903Z Sending request to start deployment - pipelines/cc77e870-06e5-4fc6-922a-0ed7daff549f/DeployAll
2022-03-03T15:15:44.9295659Z Request Body- {
2022-03-03T15:15:44.9305228Z "isBackwardDeployment": false,
2022-03-03T15:15:44.9307325Z "newWorkspace": {
2022-03-03T15:15:44.9311351Z "capacityId": "",
2022-03-03T15:15:44.9312902Z "name": "Test"
2022-03-03T15:15:44.9314305Z },
2022-03-03T15:15:44.9315545Z "updateAppSettings": {
2022-03-03T15:15:44.9317059Z "updateAppInTargetWorkspace": true
2022-03-03T15:15:44.9318366Z },
2022-03-03T15:15:44.9319687Z "sourceStageOrder": 0,
2022-03-03T15:15:44.9320751Z "options": {
2022-03-03T15:15:44.9321872Z "allowTakeOver": false,
2022-03-03T15:15:44.9322862Z "allowOverwriteArtifact": true,
2022-03-03T15:15:44.9323780Z "allowPurgeData": false,
2022-03-03T15:15:44.9324820Z "allowSkipTilesWithMissingPrerequisites": false,
2022-03-03T15:15:44.9328835Z "allowCreateArtifact": true,
2022-03-03T15:15:44.9539735Z "allowOverwriteTargetArtifactLabel": false
2022-03-03T15:15:44.9541321Z }
2022-03-03T15:15:44.9541692Z }
2022-03-03T15:15:48.5597144Z ##[error]Response status code does not indicate success: 400 (Bad Request).
2022-03-03T15:15:48.5818276Z ##[section]Finishing: Deploy content to the Test stage

Thanks,
Manjunath

PowerBI Deployment Pipeline Integration with Azure DevOps

Deploying Power BI .pbix file from Azure DevOps pipeline calling Power BI deployment pipeline is working fine for only three instances and rest of the instances are showing deployment as successful in Azure DevOps, but deployment is not happening in Power BI workspace beyond three instances.

I have created Power BI pipeline for deploying dataset file into 5 instances which is happening in Power BI pipeline. But when I created pipeline in Azure DevOps with 'Power BI actions' as first task to deploy dataset file in Dev environment and subsequent tasks using 'Deploy content to the test' to deploy same file into remaining environments. After running this pipeline in Azure DevOps, all the tasks are shown successful in DevOps, but actual deployment is happening only for first three tasks in Power BI where deployment is unsuccessful in remaining couple of remaining environments.

is this being released this month?

as per the documentation page - https://learn.microsoft.com/en-us/power-platform-release-plan/2022wave1/power-bi/deployment-pipelines-azure-devops-extension , this extension will be generally available this month. Is it going to be updated in this month's release?

https://marketplace.visualstudio.com/items?itemName=ms-pbi-api.pbi-automation-tools shows in public preview.

Thanks,
Arjun

Powerbi Automation Tools : Azure-Pbi Pipelining Error "A pipeline with the requested name or Id was not found”

HI Guys,

I am getting an error while doing the pipeline from azure to powerbi
"A pipeline with the requested name or Id was not found” though the pipeline exists and i have all necessary permissions to do pipelining. I am attaching the log for reference.
tasklog_6.log

"Failed to populate environments in settings" from On-Prem ADO, potential proxy issue, limitation of Powershell 3?

Here are a few assumptions I'm making

I am using On-Premise Azure DevOps Server
The task group connects using Powershell 3 and not Powershell Core based on this line from the AddUsers task group json
"execution": { "PowerShell3": { "target": "Run.ps1" } }
Based on a similar Azure module, there is not a great way to set proxy environment variables for Powershell versions lower than 7
https://docs.microsoft.com/en-us/powershell/azure/az-powershell-proxy?view=azps-7.3.0
Normally for other Azure tasks that have issues getting out, we set the proxy variable in the Azure DevOps pipeline variables like this, and this works fine:
If I force a normal Powershell Task to run as Powershell Core (i.e. Powershell 7+), it takes the http_proxy, https_proxy and I am able to do Invoke-WebRequests to api.powerbi.com and app.powerbi.com. If I do not set this, I cannot reach these hosts
Given above, I am able to connect to Power BI with a Powershell Task, Connect-PowerBIServiceAccount if I include all of the libraries, etc. if I run as Powershell Core + proxy settings in the env variables

Even with setting the proxy ADO env vars, we receive this error when running the Add-Users task group (other Power BI extension tasks do this as well):

##[section]Starting: Add a user to a workspace
==============================================================================
Task         : Add a user to a workspace
Description  : Add a user to a Power BI workspace
Version      : 1.0.3
Author       : Microsoft
Help         : 
==============================================================================
Importing module MicrosoftPowerBIMgmt.Profile
Connecting to Power BI with ServicePrincipal
##[error]Failed to populate environments in settings
##[section]Finishing: Add a user to a workspace

We would like to continue to be able to set the environment variable proxy within an ADO release, instead of setting this on the Azure DevOps VM server wide so the proxy can be set only as needed. Is there a way we can force this extension to run as Powershell Core/7, or another setting to allow Powershell 3 to pickup a proxy? Thanks.

Get Datasets and Get Parameters in a Group as new Action

In order to set parameters for datasets as requested in #16 it is required to get the list of datasets in a workspace so that you can iterate over the list of datasets and set parameters or trigger dataset refresh etc.

Datasets in a workspace can be retrieved using Get Datasets In Group

Dataset Parameters in a workspace can be retrieved via Get parameters in a Group

It's not working with shared connections

It stop working if I use Shared Connections in Semantic Model settings when I deploy content from Azure DevOps

Recommend Projects

React

A declarative, efficient, and flexible JavaScript library for building user interfaces.
Vue.js

🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
Typescript

TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
TensorFlow

An Open Source Machine Learning Framework for Everyone
Django

The Web framework for perfectionists with deadlines.
Laravel

A PHP framework for web artisans
D3

Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

javascript

JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
web

Some thing interesting about web. New door for the world.
server

A server is a program made to process requests and deliver data to clients.
Machine learning

Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Visualization

Some thing interesting about visualization, use data art
Game

Some thing interesting about game, make everyone happy.

Recommend Org

Facebook

We are working to build community through open source technology. NB: members must have two-factor auth.
Microsoft

Open source projects and samples from Microsoft.
Google

Google ❤️ Open Source for everyone.
Alibaba

Alibaba Open Source for everyone
D3

Data-Driven Documents codes.
Tencent

China tencent open source team.

microsoft / powerbi-azure-pipelines-extensions Goto Github PK