Git Product home page Git Product logo

azure-cloud-utils's Introduction

azure_cloud_utils

https://docs.microsoft.com/en-us/azure/

Certifications Links:

  1. https://github.com/anjijava16/Azure-Certification-DP-200
  2. https://www.udemy.com/course/microsoft-azure-database-and-analytics/
  3. https://github.com/MicrosoftLearning/AZ-900T0x-MicrosoftAzureFundamentals/tree/master/Instructions/Walkthroughs

Azure Data Storage:

  1. https://knowledge-junction.com/2020/12/03/microsoft-azure-storage-and-database-part-1-overview/

CosmosDB

Azure Cosmos DB supports many APIs, such as SQL, MongoDB, Cassandra, Gremlin, and Table. Each API has its own set of database operations. These operations range from simple point reads and writes to complex queries. Each database operation consumes system resources based on the complexity of the operation. https://github.com/cmaneu/Awesome-Azure-Advanced-Analytics#azure-cosmos-db https://azurecosmosdb.github.io/labs/ https://github.com/abhirockzz/cosmosdb-synapse-workshop

Synapse (Data Cloud Anlaytics)

https://github.com/Azure-Samples/Synapse/tree/master/Notebooks/PySpark/Synapse%20Link%20for%20Cosmos%20DB%20samples

 https://github.com/microsoft/hyperspace
  An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.

Implementing-an-Azure-Data-Solution:

  1. https://github.com/MicrosoftLearning/DP-200-Implementing-an-Azure-Data-Solution

Designing-an-Azure-Data-Solution:

  1.  https://github.com/MicrosoftLearning/DP-201-Designing-an-Azure-Data-Solution
    

You can do free labs on microsoft learn for handon

  1. https://docs.microsoft.com/en-us/learn/
  2. https://azure.microsoft.com/en-us/free/

Core principles for creating architectures

  1. https://docs.microsoft.com/en-us/learn/modules/pillars-of-a-great-azure-architecture/
  2. Big data architectures (imp): Understand why, when and differences
  3. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/
  4. https://www.blue-granite.com/blog/a-different-way-to-process-data-kappa-architecture

Describe Lambda architectures from a Batch Mode Perspective

  1. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/batch-processing
  2. https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/batch-processing
  3. https://docs.microsoft.com/en-us/azure/cosmos-db/lambda-architecture

. Design an Enterprise BI solution in Azure

  1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/enterprise-bi-sqldw
  2. https://azure.microsoft.com/en-in/blog/technical-reference-implementation-for-enterprise-bi-and-reporting/

Automate enterprise BI solutions in Azure

  1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/enterprise-bi-adf

Architect an Enterprise-grade conversational bot in Azure (understand data/storage requirements)

  1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/ai/conversational-bot

#. Lambda architectures for a Real-Time Mode Perspective

  1. https://docs.microsoft.com/en-us/azure/architecture/data-guide/big-data/real-time-processing

#. Architect a stream processing pipeline with Azure Stream Analytics

  1. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-solution-patterns
  2. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/stream-processing-stream-analytics
  3. https://docs.microsoft.com/en-us/azure/architecture/data-guide/technology-choices/stream-processing

#. Design a stream processing pipeline with Azure Databricks

  1. https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/data/stream-processing-databricks

#. Security Design Considerations

  1. https://docs.microsoft.com/en-us/learn/modules/design-for-security-in-azure/

#. Designing distributed tables in Azure SQL Data Warehouse

  1. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-distribute
  2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-best-practices

#. Horizontal, vertical, and functional data partitioning

  1. https://docs.microsoft.com/en-us/azure/architecture/best-practices/data-partitioning #. Azure Cosmos DB: Designing your data structure
  2. https://social.technet.microsoft.com/wiki/contents/articles/39421.azure-cosmos-db-designing-your-data-structure.aspx #. Azure Example Scenarios
  3. https://docs.microsoft.com/en-us/azure/architecture/example-scenario/#data-scenarios #. Datasize organizing in one folder
  4. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-performance-tuning-guidance
  5. https://azure.microsoft.com/en-in/blog/azure-cosmos-db-pushing-the-frontier-of-globally-distributed-databases/
  6. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-temporary

#. Transparent data encryption or always encrypted

  1. https://azure.microsoft.com/en-in/blog/transparent-data-encryption-or-always-encrypted/ #. SQL database auditing
  2. https://docs.microsoft.com/en-us/azure/sql-database/sql-database-auditing
  3. https://docs.microsoft.com/en-us/sql/relational-databases/security/auditing/sql-server-audit-database-engine?view=sql-server-2017

#. Azure SQL Database security capabilities

  1. https://docs.microsoft.com/en-us/azure/sql-database/sql-database-security-overview #. Data Compression
  2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-memory-optimizations-for-columnstore-compression
  3. https://blogs.msdn.microsoft.com/sqldw/2016/05/05/the-effects-of-column-level-compression/

#. Storage :

  1. https://docs.microsoft.com/en-us/azure/architecture/guide/technology-choices/data-store-comparison
  2. https://docs.microsoft.com/en-us/azure/storage/common/storage-account-overview

#. Introduction to Data Lake Storage & Create an Azure Data Lake Storage Gen2

  1. https://docs.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction
  2. https://www.blue-granite.com/blog/10-things-to-know-about-azure-data-lake-storage-gen2 (Good Article)
  3. Enabling Team Based Data Science with Azure Databricks
  4. https://www.blue-granite.com/blog/3-reasons-to-choose-azure-databricks-for-data-science-and-big-data-workloads
  5. https://www.slideshare.net/databricks/building-an-enterprise-data-platform-with-azure-databricks-to-enable-machine-learning-and-data-science-at-scale-at-sams-club

. Azure Databricks & :

  1. https://docs.azuredatabricks.net/getting-started/concepts.html
  2. ETL: https://docs.microsoft.com/en-us/azure/azure-databricks/databricks-extract-load-sql-data-warehouse Globally Distributed Database with Azure Cosmos DB,Create an Azure Cosmos DB database built to scale ,Insert and query data in your Azure Cosmos DB database:
  3. https://docs.microsoft.com/en-us/azure/cosmos-db/consistency-levels
  4. https://docs.microsoft.com/en-us/azure/cosmos-db/whitepapers
  5. https://docs.microsoft.com/en-us/azure/cosmos-db/databases-containers-items
  6. https://docs.microsoft.com/en-us/azure/cosmos-db/how-to-multi-master

Distribute your Data Globally with Azure Cosmos DB:

  1. https://docs.microsoft.com/en-us/azure/cosmos-db/global-dist-under-the-hood
  2. https://azure.microsoft.com/en-in/blog/a-technical-overview-of-azure-cosmos-db/ (must read)
  3. https://docs.microsoft.com/en-us/azure/architecture/best-practices/data-partitioning (Do read)

Azure SQL Database

  1. https://docs.microsoft.com/en-in/azure/sql-database/ (Read only concept section on left hand side)

Azure SQL Data Warehouse :

  1. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-partition
  2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-best-practices
  3. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-tables-overview
  4. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/massively-parallel-processing-mpp-architecture (Do read)

Creating and Querying an Azure SQL Data Warehouse :

  1. https://azure.microsoft.com/en-in/resources/videos/loading-data-with-polybase-in-azure-sql-data-warehouse/
  2. https://docs.microsoft.com/en-us/azure/sql-data-warehouse/load-data-wideworldimportersdw

Performing Real Time Analytics with Stream Analytics:

  1. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-stream-analytics-query-patterns#query-example-send-data-to-multiple-outputs (one query multiple output possible go through it)
  2. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-outputs
  3. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-streaming-unit-consumption
  4. https://azure.microsoft.com/is-is/blog/maximize-throughput-with-repartitioning-in-azure-stream-analytics/
  5. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parallelization (must read)
  6. https://docs.microsoft.com/en-us/azure/stream-analytics/streaming-technologies (read all concepts from left hand side)
  7. https://docs.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs#stream-data-from-event-hubs

Orchestrating Data Movement with Azure Data Factory:

  1. https://azure.microsoft.com/en-in/resources/videos/azure-data-factory-overview/
  2. https://docs.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime (super imp: understand when to use what)
  3. https://docs.microsoft.com/en-us/azure/data-lake-store/data-lake-store-security-overview

Securing Azure Data Platforms:

  1. https://docs.microsoft.com/en-us/azure/security/azure-security-data-encryption-best-practices

azure-cloud-utils's People

Contributors

anjijava16 avatar

Watchers

 avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.