Git Product home page Git Product logo

edc's Introduction

Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNN

Duolikun Danier, Fan Zhang, David Bull

Project | Paper

Dependencies and Installation

The following packages were used to evaluate the model.

  • python==3.8.8
  • pytorch==1.7.1
  • torchvision==0.8.2
  • cudatoolkit==10.1.243
  • opencv-python==4.5.1.48
  • numpy==1.19.2
  • pillow==8.1.2
  • cupy==9.0.0

Installation with anaconda:

conda create -n edc python=3.8.8
conda activate edc
conda install pytorch==1.7.1 torchvision==0.8.2 cudatoolkit=10.1 -c pytorch
conda install -c conda-forge cupy
pip install opencv-python==4.5.1.48

Model

Paper

Preparing test data

  • Download UCF101 quintuplets from here.
  • Download DAVIS sequences from here.
  • Download VFITex dataset from here.

The dataset folder names should be lower-case and structured as follows.

└──── <data directory>/
    ├──── ucf101/
    |   ├──── 0/
    |   ├──── 1/
    |   ├──── ...
    |   └──── 99/
    ├──── davis90/
    |   ├──── bear/
    |   ├──── bike-packing/
    |   ├──── ...
    |   └──── walking/
    ├──── snufilm/
    |   ├──── test-easy/
    |   ├──── test-medium/
    |   ├──── test-hard/
    |   ├──── test-extreme/
    |   └──── data/
    └──── vfitex/
        ├──── beach02_4K_mitch/
        ├──── bluewater_4K_pexels/
        ├──── ...
        └──── waterfall_4K_pexels/

Downloading the pre-trained model

Download the pre-trained network from here.

Evaluation

python evaluate.py \
--net EDC \
--data_dir <data directory> \
--checkpoint <path to pre-trained model (.pth file)> \
--out_dir eval_results \
--dataset <dataset name>

where <dataset name> should be the same as the class names defined in data/testsets.py, e.g. Snufilm_extreme_quintuplet.

Citation

@misc{danier2022enhancing,
    title={Enhancing Deformable Convolution based Video Frame Interpolation with Coarse-to-fine 3D CNN}, 
    author={Duolikun Danier and Fan Zhang and David Bull},
    year={2022},
    eprint={2202.07731},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

Acknowledgement

Lots of code in this repository are adapted/taken from the following repositories:

We would like to thank the authors for sharing their code.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.