Git Product home page Git Product logo

linux-image-validations's Introduction

Validations for Linux Images on Azure (Vhd Supported)

Use this script/pipeline to check if your custom linux image (Vhd) built works on Azure.

Table of Contents

  1. Motivation
  2. Requirements
    1. Linux / macOS / Windows
    2. Azure Pipelines
    3. Azure Cloud Shell
  3. Installation
  4. Working
    1. Setup
      1. Current Setup
      2. Future Setup
    2. Output
      1. Current Available Output
      2. Future Enhancement
      3. Example
    3. Validations
      1. Current Available Validations
      2. Future Support / Enhancement
  5. Contributing to the Repository
    1. Areas of contribution
    2. Feature Request, Issue and Bug Reporting
    3. Code Optimizations / Enhancements
    4. Microsoft OpenSource code of conduct
  6. Maintainers

Motivation

We wish to help our customers and also the community who are using Azure to use their Linux Virtual Machines with custom images and generalized images with less hassle. Hence the requirement of this pipeline which the customer/community can fork in their repositories and run as part of their regular validations.

This can also be used by Support teams across and outside Microsoft to validate incoming customers' images using Azure Cloud Shell

Requirements

Linux / macOS / Windows

  1. Terraform
    1. Azure Provider
  2. Azure Account
    1. Azure AAD Appliation Id Setup
    2. Currently AAD Application ID and Client Secret is Supported
    3. Ensure that Azure App has contributor access

Azure Pipelines

  1. Ensure that Terraform is available on Azure pipeline
  2. Ensure that relevant pipeline variables are set

Azure Cloud Shell

All requirements are met. Terraform is already installed by default.

Installation

  1. Ensure that Requirements is met
  2. clone the repo using the following command
    git clone https://github.com/Azure/linux-image-validations
  3. Tar the validations folder using the following command
    tar -cvzf validations/* validator.tar.gz
  4. Ensure that validator.tar.gz is present inside an Azure Storage Account.
    https://storage_account.blob.core.windows.net/container/validator.tar.gz
    
  5. Create a file called validate_upload.sh with the following details and place it inside the storage account
    #!/bin/bash -e
    generation=$2
    vhdName=$1
    sudo $(which tar) -xzf validator.tar.gz
    
    [[ -n "$(uname -a | grep -i $distro)" || -n "$(uname -a | grep -i debian)" ]] && sudo $(which python) validate.py
    [[ -n "$(uname -a | grep -i $redhat)" || -n "$(uname -a | grep -i centos)" ]] && sudo $(which platform_python) validate.py 
    
    cat logs.json
    
    # Example of a curl call
    echo "https://contoso.com/images/$vhdName/validation/$generation"
    curl --location --request POST "https://contoso.com/images/$vhdName/validation/$generation" \
    --header 'Content-Type: application/json' -d @logs.json
    
  6. For folks who wish to run from commandline. Do note that this is to be performed after previous steps are in place.
    1. Deploying Resources (Terraform variables / Environment variables can also be used)
    cd linux-image-validations/azure
    terraform apply
    1. Cleanup of Resources
    cd linux-image-validations/azure
    terraform destroy
    

Working

Terraform is used in setting up of the infrastructure. Python is used to run the scripts inside the Virtual Machine using the Azure Custom Script Extension By doing so will perform the inherent validations such as WALinuxAgent Availability

Setup

Current Setup

  1. Single VM
  2. Single nic support
  3. Testing of Generation 1 and Generation 2 Virtual Machine.
  4. HA Not supported
  5. Input is currently the SAS Uri to the Linux VHD.

Future Setup

  1. High Availability with cluster
  2. Multiple NIC support

Output

Output is currently rendered in JSON We are currently in the Information Gathering wherein most of the details is not validated rather than displayed directly. The output details are currently available in logs.json

Currently Available

System
  1. /proc/cmdline - This is used to check if the VM supports Serial console
  2. Grub configuration - This is used to check if the VM supports Serial console
  3. OS Release and Kernel Version
  4. Disk Usage Report
  5. MBR/EFI Boot
Package Manager
  1. Repo availability - (yum and dnf)

Future Support

  1. Driver details
  2. Cloud-Init details
  3. Instance Metadata Service (IMDS)

Example

JSON Output

Validations

Current Validations Performed

  1. Generation 1 and Generation 2 VM Bootability
  2. WALinuxAgent Availability.
  3. Network Connectivity
  4. Repo Availability (Currently Yum and dnf supported)

Future Validations

  1. Azure Site Recovery
  2. Cloud-Init validation

Linux Distribution Supported

Current

  1. RedHat
  2. CentOS

Future Support

  1. SLES
  2. OpenSUSE
  3. Ubuntu - (Works - E2E testing is required)
  4. Debian - (Works - E2E testing is required)

Contributing

We sincerely welcome contributions from our customers and community. Together we believe that we can make this a better validation system for Linux Images on Azure.

Areas

  1. Documentation
  2. Code Enhancement
  3. Testing and Bug Reports

Issue and Bug Reporting

Issue Template to report Bugs and bugs are tracked on issues tab. This can also be used to propose new feature request. Please turn the feature-request flag

[Issue Occurrence - Optional]
Short one-liner issue statement

[Environment]
1. Linux / Windows / OS X
2. Azure Pipelines
3. CloudShell

[Description]
Provide Detailed Description explaining the issue statement
Add Screenshots / Snippets / Error messages if available

[Steps to Reproduce]

[Severity]

Code Enhancement

  1. naming convention for terraform scripts - snake_case for variables
  2. PEP-8 for Python is followed
  3. Commit Message format.
    <Repo Name / Work Name>: Short one-liner of the work
    
    Description:
    <Provide your description in brief>
    
    Signed-off-by: 
    
    Multiple file changes involving multiple work should be submitted with multiple commits.

Code of Conduct

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

Maintainers

  1. Sriharsha B S
  2. Pankaj Basnal
  3. Abhilash Gopal

linux-image-validations's People

Contributors

abgopal avatar anujkmaurya avatar lmuppa avatar microsoft-github-operations[bot] avatar microsoftopensource avatar navpreetkaur1098 avatar pbasnal avatar simratsatia avatar sribs avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

linux-image-validations's Issues

Read me Obsolete

linux-image-validations is available to use for General public.

I would appreciate if we can have a read me which encloses new changes. Recently when I checked, ansible image validation has been added

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.