Git Product home page Git Product logo

abdullah-abuolaim / multi-task-defocus-deblurring-dual-pixel-nimat Goto Github PK

View Code? Open in Web Editor NEW
43.0 6.0 2.0 142.21 MB

Reference github repository for the paper "Improving Single-Image Defocus Deblurring: How Dual-Pixel Images Help Through Multi-Task Learning". We propose a single-image deblurring network that incorporates the two sub-aperture views into a multitask framework. Specifically, we show that jointly learning to predict the two DP views from a single blurry input image improves the network’s ability to learn to deblur the image. Our experiments show this multi-task strategy achieves +1dB PSNR improvement over state-of-the-art defocus deblurring methods. In addition, our multi-task framework allows accurate DP-view synthesis (e.g., ~ 39dB PSNR) from the single input image. These high-quality DP views can be used for other DP-based applications, such as reflection removal. As part of this effort, we have captured a new dataset of 7,059 high-quality images to support our training for the DP-view synthesis task.

License: Apache License 2.0

Python 100.00%
deep-neural-networks computer-vision deep-learning dataset deeplearning datasets computational-photography autofocus synthetic-data depth-of-field

multi-task-defocus-deblurring-dual-pixel-nimat's People

Contributors

abdullah-abuolaim avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

multi-task-defocus-deblurring-dual-pixel-nimat's Issues

dataset release

Hi! Thank you for the great work. May I ask if there are any plans to release the dataset?

some question about training 2 phase

hi,when I am according to the process ,configured the environment,while use the mdp_phase_1_wacv.hdf5 as the pretrained model,when training finished,I just get the PSNR=24.64 ,the parameter I changed 'ing_mini_b' from 8 to 6,because of the memory limited.The other parameters I didn't change.The dataset I choose is DPDD dataset,350 pairs images as the training dataset.the GPU is 2 NVIDIA 1080Ti.I don't know why

Bug in the phase 1 training

Invalid argument: ValueError: could not broadcast input array from shape (512,500,3) int$
shape (512,512,3)
Traceback (most recent call last):

File "/home/user/lib_local/miniconda3/lib/python3.8/site-packages/tensorflow/python/ops/script_ops.py", line 249, in call
ret = func(*args)

File "/home/user/lib_local/miniconda3/lib/python3.8/site-packages/tensorflow/python/autograph/impl/api.py", line 645, in wrapper
return func(*args, **kwargs)

File "/home/user/lib_local/miniconda3/lib/python3.8/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 892, in generator_py_func
values = next(generator_state.get_iterator(iterator_id))

File "/home/user/lib_local/miniconda3/lib/python3.8/site-packages/tensorflow/python/keras/engine/data_adapter.py", line 839, in wrapped_generator
for data in generator_fn():

File "/data/user/liaozk/multi-task-defocus-deblurring-dual-pixel-nimat-main/mdp_code/data.py", line 205, in generator
src_ims[i] = img_src_c[s_p[0]:e_p[0],s_p[1]:e_p[1],:]

ValueError: could not broadcast input array from shape (512,500,3) into shape (512,512,3)

Thank you for your contribution. Have you ever meet this bug in the training phase 1? Thank you

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.