Git Product home page Git Product logo

densemapnet's Introduction

DenseMapNet

Keras code of "Fast Disparity Estimation using Dense Networks" paper at the International Conference on Robotics and Automation, Australia, 2018 (ICRA 2018)

DenseMapNet Features

  • Predicts disparity map using full resolution stereo RGB
  • Fast at >=30Hz on NVIDIA 1080Ti GPU
  • Tiny network with only 290k parameters
  • Accurate with Low End-Point-Error or EPE

Sample Predictions

Driving, Monkaa, and Flying Datasets

Driving, Monkaa and Flying datasets

KITTI 2015

KITTI 2015

Demo

DenseMapNet Demo

Dataset

Download datasets:

  1. driving
  2. mpi

Copy: cp driving.tar.bz2 densemapnet/dataset

Change dir and extract: cd densemanpnet/dataset; tar jxvf driving.tar.bz2

Available datasets:

  1. driving - Driving
  2. mpi - MPI Sintel

Additional datasets will be available in the future.

Training

In some datasets, the train data is split into multiple files. For example, driving is split into 4 files while mpi fits into 1 file.

To train the network:

python3 predictor.py --dataset=driving --num_dataset=4

Alterntaively, load the pre-trained weigths:

python3 predictor.py --dataset=driving --num_dataset=4 --weights=checkpoint/driving.densemapnet.weights.h5

Testing

To measure EPE using test set:

python3 predictor.py --dataset=driving --num_dataset=4 --weights=checkpoint/driving.densemapnet.weights.h5 --notrain

To benchmark speed only:

python3 predictor.py --dataset=driving --num_dataset=4 --weights=checkpoint/driving.densemapnet.weights.h5 --predict

To generate disparity predictions on both train and test datasets (complete sequential images used to create the video):

python3 predictor.py --dataset=driving --num_dataset=4 --weights=checkpoint/driving.densemapnet.weights.h5 --predict --images

Citation

If you find this work useful, please cite:

@conference{Atienza18,
  title = {Fast Disparity Estimation using Dense Networks},
  author = {Atienza, Rowel},
  booktitle = {Proceedings 2018 IEEE International Conference on Robotics and Automation (ICRA)},
  publisher = {IEEE},
  address = {Piscataway, NJ, USA},
  month = May,
  year = {2018},
  month_numeric = {5}
}

densemapnet's People

Contributors

roatienza avatar

Stargazers

Giselle E. avatar

Watchers

James Cloos avatar Giselle E. avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.