Git Product home page Git Product logo

aws-download's Introduction

Downloading NUCAPS from the NODD

NOAA products are available via cloud resources as part of the NOAA Open Data Dissemination (NODD) program.

The NODD duplicates the data available on NOAA CLASS and is updated in near-real time. The program starts ~Oct 2022, so the entire record is not available.

It's straightforward to download real-time data using scripting languages like Python. The repository contains a simple sample script to query AWS for the NUCAPS OLR.

Pre-requisites

You will need python (I recommend Anaconda or Miniconda). You will also need the s3fs package. The installation syntax is below, type it into the Terminal (MacOS/Linux users) or the Anaconda Prompt (Windows users)

conda install s3fs -c conda-forge

Editing the script

You will need to open up the download_data.py file and edit the date product and date range that you are downloading. The script can be easilly altered to download another JPSS product.

select the product:

product = 'NOAA20_NUCAPS-EDR'
# other choices: NOAA20_NUCAPS-EDR, NOAA20_NUCAPS-CCR, NOAA20_NUCAPS-OLR

Update the date range:

year = 2023
month = 4
day = 22

start_time = '0000'
end_time = '2359'

You can also download the most recent data using:

# use today's date 
dt = datetime.datetime.now()
year = dt.strftime('%Y')
month = dt.strftime('%m')
day = dt.strftime('%d')

start/end hour-min
one_hour_ago = dt - datetime.timedelta(hours=1)

start_time = one_hour_ago.strftime('%H%m')
end_time = dt.strftime('%H%m')

Save and exit the script when you are done.

Running the Script

To run the script, simply type:

python download_data.py

Need additional help?

See our tutorial from AMS 2023 on downloading data from the cloud.

Authors

Code developed by Rebekah Esmaili (STC) and Amy Huff (IMSG).

aws-download's People

Contributors

resmaili avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.