Git Product home page Git Product logo

aml_hpc's Introduction

run the following from repo root

1. Login

az login --tenant <tenant>
az account set -s <subscription>

2. Run setup infra script

Create a .env file at root level of the repo (gitignored) as per the sample provided.

Then run the setup script.

bash infra/setup.sh

Verify the resources created in the Azure portal:

  • Resource group
  • Azure ML workspace and associated resources
  • VM and associated resources

3. Networking

update the vm NSG to allow network access from Azure ML workspace

(here, we're using the portal and configuring an allow rule for the Azure ML service tag, i.e. any ML workspace would be allowed to connect to this VM) nsg

4. Attach the VM to Azure ML workspace

source .env
az ml compute attach -f definitions/compute/attached-vm.yml --resource-id $VM_ID --admin-password $VM_PASSWORD

This should result in a new compute visible through CLI:

az ml compute list -o table
-->
Name        Compute type    State
----------  --------------  ---------
vm-example  virtualmachine  Succeeded

or portal:

aml_compute

4a. (Optional) Create an Azure Compute Instance and cluster for comparison

az ml compute create -f definitions/compute/aml-compute-instance.yml
az ml compute create -f definitions/compute/aml-compute-cluster.yml

5. Submit a job

az ml job create -f definitions/job/simplejob/job.yml

โŒ Currently seeing error without useful explanation: "UserError: Unable to establish SSH connection". Allowing access on all ports from anywhere on the NSG does not fix it. Perhaps try using ssh key instead of password for the VM.

๐Ÿ‘‰ Expected outcome (obtained running on AML CI):

job_success

aml_hpc's People

Contributors

lindacmsheard avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.