Git Product home page Git Product logo

ossp's Introduction

OSSP

Open Source Sea-ice Processing

Open Source Algorithm for Detecting Sea Ice Surface Features in High Resolution Optical Imagery

Nicholas Wright and Chris Polashenski

Introduction

Welcome to OSSP; a set of tools for detecting surface features in high resolution optical imagery of sea ice. The primary focus is on the detection of and differentiation between open water, melt ponds, and snow/ice.

The Anaconda distribution of Python is recommended, but any distribution with the appropriate packages will work. You can download Anaconda, version 3.6, here: https://www.continuum.io/downloads

Dependencies

  • gdal (v2.0 or above)
  • numpy
  • scipy
  • h5py
  • scikit-image
  • sklearn
  • matplotlib
  • tkinter

Optional

Usage

For detailed usage and installation instructions, see the pdf document 'Algorithm_Instructions.pdf'

setup.py

The first step is to run the setup.py script to compile C libraries. Run python setup.py build_ext --build-lib . from the OSSP directory. Be sure to include the period after --build-lib.

ossp_process.py

This combines all steps of the image classification scheme into one script and should be the only script to call directly. If given a folder of images, this script finds all appropriately formatted files directory (.tif(f) and .jpg) and queues them for processing. If given an image file, this script processes that single image alone. This script processes images as follows: Image preprocessing (histogram stretch or pansharpening if chosen) -> segmentation (segment.py) -> classification (classify.py) -> calculate statistics. Output results are saved as a geotiff with the same georeference of the input image.

Required Arguments

  • input directory: directory containing all of the images you wish to process. Note that all .jpg and .tif images in the input directory as well as all sub-directories of it will be processed. Can also provide the path and filename to a single image to process only that image.
  • image type: {‘srgb’, ‘wv02_ms’, ‘pan'}: the type of imagery you are processing.
    1. 'srgb': RGB imagery taken by a typical camera
    2. 'wv02_ms': DigitalGlobe WorldView 2 multispectral imagery
    3. 'pan': High resolution panchromatic imagery
  • training dataset file: filepath of the training dataset you wish to use to analyze the input imagery

Optional Arguments

  • -o | --output_dir: Directory to write output files.
  • -v | --verbose: Display text output as algorithm progresses.
  • -c | --stretch: {'hist', 'pansh', 'none'}: Apply an image correction prior to classification. Pansharpening / orthorectification option requires PGC scripts. Default = hist.
  • -t | --threads: Number of subprocesses to spawn for classification. Threads > 2 is only utilized for images larger than ~10,000x10,000 pixels.
  • --pgc_script: Path for the PGC imagery_utils folder if 'pansh' was chosen for the image correction.
  • --training_label: The label of a custom training dataset. See advanced section for details. Default = image_type.

Notes:

Example: ossp_process.py input_dir im_type training_dataset_file -v

This example will process all .tif and .jpg files in the input_dir.

training_gui.py

Graphical user interface for creating a custom training dataset. Provide a directory of images that you wish to use as the basis of your training set. The GUI will present a random segment each time a classification is assigned. The display images can also be clicked classify a specific area. The segments themselves are automatically generated. The highlighted region corresponds to the segment that will be labeled.

Output is a .h5 file that can be provided to ossp_process.py.

Note: Images are segmented prior to display on the GUI, and as such may take up to a minute to load (depending on image size and computer specs)

Positional Arguments:

  • input: A directory containing the images you wish to use for training.
  • image type: {‘srgb’, ‘wv02_ms’, ‘pan'}: the type of imagery you are processing.
    1. 'srgb': RGB imagery taken by a typical camera
    2. 'wv02_ms': DigitalGlobe WorldView 2 multispectral imagery,
    3. 'pan': High resolution panchromatic imagery

Optional arguments:

  • --tds_file: Existing training dataset file. Will create a new one with this name if none exists. If a path is not provided, file is created in the image directory. Default = <image_type>_training_data.h5.
  • --username: A specific label to attach to the training set. The --training_label argument of ossp_\process references this value. Default = <image_type>

Contact

Nicholas Wright

ossp's People

Contributors

wrightni avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.