Git Product home page Git Product logo

adu's Introduction

ADU - Analytics Platform System Appliance Diagnostic Utility with Wellness Checks

Usage

You can download the newest releast from the 'release' page. Extract the downloaded file (ADU-version.zip) to HST01 under C:. The name of the ADU folder is not important unless you have set up automated jobs that depend on a particular folder structure. By default it will look like this: C:\ADU\ADU.ps1

Execute it using PowerShell: C:\ADU\ADU.ps1

A menu will be displayed to select your options. All of these are safe to run while the appliance is online, but as a best practice you should not be making changes to the appliance under the highest volume times due to possible performance impact on the appliance or diagnostic tool.

Current Version / Changes

07/28/2021, v4.8 Change: DataBase_SpaceUtil_ByVolume modified to include TempDB and PDWTempDB, and rollup space utilization to the volume (previously reported individual files, rather than summary by db by volume).

Functionality

  • Diagnostics Collection: Collect logs and diagnostic data from appliance
  • Distributed command: Run a command on all nodes or a subset of nodes.
  • Check WMI Leak: Checks that WMI has not had any leaks and fixes it if required (online)
  • Fix Network Connection Profile: Checks for adapters on the wrong profile and attempts to repair it (onlin)
  • Get Network adapter Config: Retrieves the IP configuration from all network adapters in the appliance
  • Manage Performance Counters: Turn performance counters on or off on all nodes of the appliance.
  • Publish PDW XMLs: Copy one set of XMLs out to the rest of the servers.
  • Set External Time Source: Will ask for an NTP server and attempt to set the appliance to sync to that source
  • All Table Sizes: Collects size and rowcount for all tables in selected database (or all)
  • Audit SQL Security Logs:
  • Backup Test:
  • Database Space Report: Retrieves used and unused database space including the specified space when DB was created.
  • Distributed Table Sizes: Collects size of all distributed tables in selected database (or all)
  • Failed Data Loads:
  • Last Modified Statistics: Collects the last modified date for all statistics on all tables in the specified database (or all)
  • Orphaned Table Listing: Checks all databases for orphaned tables
  • Replicated Table Sizes: Collects size of all replicated tables. Generally to make sure none are too large.
  • Replicated vs Distributed space by filegroup: Collects the space usage by filegroup
  • Run PAV: Runs Appliance Validator
  • Table Info:
  • Table Skew: Collects table skew for all tables in specified database (or all)
  • Add Canpool Disks to storage pool: Adds any disks that are not part of the storage pool to the storage pool
  • Align Disks: Aligns CSVs to their proper owners for best performance
  • Data Volume Utilization: Returns space usage from the volume level
  • Remove Lost Communication Disks: Removes any metadata leftover form removed disks
  • Storage Health Check: Runs a health check against the storage subsystem. Results in HTML
  • Update Storage Cache: Updates storage cache on all physical servers
  • Wellness Checks: A gui will come up so you can choose what tests you want. Details below.

Wellness Checks

Wellness checks will open a gui where you can select the tests you would like to run. The output will be in HTML format, but some of it is best copied into excel for in depth review of the results.

  • Run PAV: Run Appliance Validator from HST01
  • Analyze PAV Results: Analyze PAV results and put them in a readable format
  • Active Alerts: Collect any current active PDW alerts
  • PDW Password Expiry: Check for windows users passwords expiring in the next 7 days
  • C Drive Free Space: Checks that all servers/VMs have adequate free space
  • D Drive Free Space: Checks that all servers/VMs have adequate free space
  • WMI Health: Checks that WMI has not had any leaks
  • Replicated Table Sizes: Checks for large replicated tables
  • Statistics Accuracy: Checks the accuracy of existing statistics
  • CCI Health: Checks the health of Clustered Columnstore Indexes
  • Unhealthy Physical Disks: Checks for physical disks in unhealhty state
  • Retired Physical Disks: Checks for physical disks that have been retired
  • Disks with Canpool True: Checks for physical disks that are not in the storage pool
  • Unhealthy Virtual Disks: Checks for unhealthy virtual disks
  • CSV's Online: Checks that all CSV's are online
  • Unhealthy Storage Pools: Checks that storage pools are healthy
  • Number Physical Disks in Virtual Disks: Checks that every virtual disk has 2 physical disks
  • Physical Disk Reliability Counters: Checks if reliability counters indicate an iminent disk failure
  • Orphaned Tables: Checks for orphaned tables in any database
  • Data Skew: Checks that data skew is below a set threshold for all tables all databases
  • Network Adapter Profile: Checks that network adapters are all on the domain profile.
  • Time Sync Configuration: Checks that the appliance is syncing to an NTP server
  • Nullable Distribution Columns: Checks for any nullable distribution columns

adu's People

Contributors

azurenick avatar filipefumaux avatar microsoft-github-policy-service[bot] avatar microsoftopensource avatar msftgits avatar simonf-msft avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

adu's Issues

Database Space report not working correctly

The log files are not written to disk... Output path supplied in the PS window does not exist on disk (I tested this with a number of databases.

In addition, printed output is suspect. For some of my databases the Allocated Space is 10x larger than the size in DB settings...

Some examples:

Gathering Settings data for DB: XXX
Total Distributed Size: 600 GB's
Total Replicated Size: 100 GB's
Total Log Size: 60 GB's
AutoGrow Setting: On
Original Create Database Command:
Create Database XXX with (Replicated_size=100, Distributed_Size=600, Log_Size=60, AutoGrow=On);

Gathering Usage data for DB: XXX
Allocated Space (Reserved): 6042.36 GB
Data space (Used): 2397.89 GB
Allocated Unused Space(Unused data space): 3644.47 GB

Gathering Settings data for DB: YYY
Total Distributed Size: 600 GB's
Total Replicated Size: 100 GB's
Total Log Size: 60 GB's
AutoGrow Setting: On
Original Create Database Command:
Create Database YYY with (Replicated_size=100, Distributed_Size=600, Log_Size=60, AutoGrow=On);

Gathering Usage data for DB: YYY
Allocated Space (Reserved): 6042.14 GB
Data space (Used): 3017.25 GB
Allocated Unused Space(Unused data space): 3024.89 GB

Table Skew Report not working

The output of the Table Skew report is not working. I ran the report for a number of individual databases and the results were appended to the same TableSkewReport file.

The actual data for each database is truncated, with most of my databases only showing the skew percent and no row counts or space info. This report is unusable as is.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.