Git Product home page Git Product logo

code-nerf's Introduction

CodeNeRF: Disentangled Neural Radiance Fields for Object Categories

Date : 27th Feb, 2022

This contains the implementation of the paper CodeNeRF. Please refer to the project webpage for demos.

Install the environment

conda env create -f environment.yml
conda activate code_nerf

Catalog

  • Training
  • Optimizing with GT pose
  • Editing Shapes/Textures
  • Pose Optimizing

Download the data (ShapeNet-SRN)

For ShapeNet-SRN dataset, you can download it from https://drive.google.com/drive/folders/1PsT3uKwqHHD2bEEHkIXB99AlIjtmrEiR

Training

python train.py --gpu <gpu_id> --save_dir <save_dir> --jsonfiles <jsonfile.json> --iters_crop 1000000 --iters_all 1200000

JSON files contain hyper-parameters as well as data directory. 'iters_crop' and 'iters_all' are number of iterations for both cropped and whole images.

Optimizing

python optimize.py --gpu <gpu_id> --saved_dir <trained_dir>

The result will be stored in <trained_dir/test(_num)>, and each folder contains the progress of optimization, and the evaluation of test set. The final optimized results and the quantitative evaluations are stored in 'trained_dir/test(_num)/codes.pth'

BibTex

@inproceedings{jang2021codenerf,
  title={Codenerf: Disentangled neural radiance fields for object categories},
  author={Jang, Wonbong and Agapito, Lourdes},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={12949--12958},
  year={2021}
}

References

Some parts of code are borrowed from below amazing repositories.

Supplementary Video

03951-supp.mp4

License

MIT

code-nerf's People

Contributors

wbjang avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

code-nerf's Issues

could you give me the all codes and operation instructions?

I want to reason on the pictures with unposed image, but​ i found that there are still some unfinished work in the open source code. I want to get the complete code and operation instructions.

Looking forwad to your reply.
Thank you!

code release

Could you please release the code as soon as possible, i‘m very interseting in your work.Thanks!

Pre-trained Weights

Hi,

Thanks for the code release!

I was wondering if there are any pre-trained weights available?

Thanks,
Tom

About shape/texture latent codes

Hi,
I am very interested in your work. After reading the article, I have a question: What method does CodeNeRF use to encode shape/texture, I think this part of the description in the article seems not clear enough

Looking forward to your answer!

How to organize data?

After downloading the data, I'm not sure how to process it. I hope you can help me with this . Thank you!

Hello, When the code will be published? :)

Hello, Thank you for the nice work.
I am waiting for code publishing.
Could you tell me the estimated schedule?
It would help so much.

Thanks for the good research again.

How to jointly optimize the pose?

Hi,
I tried to optimize the camera pose jointly with shape and texture codes, where I set the azimuth and elevation as 0 and distance as 0.5 in the beginning, and add the parameters in the optimizer. However the result is still blurry after 500 iterations, I would like to ask if this is normal or I miss something in the steps?
opt1_499
opt1_999

Code release

Thanks for sharing such a great work!

I'm looking forward to the code release. It would be better if the code is implemented with PyTorch.

Thanks!

How to optimize and estimate the camera pose

Hello,

Thank you very much for the code release!

Refer to the paper "codeNeRF", I find the camera pose, shape and texture code are jointly optimized during testing/inference.

But in the open-source file "optimizer.py" (the function "optimize_objs"), it seems that the ground truth camera pose is used directly and only the shape and texture code are optimized.

Do I miss something or misunderstanding the code?

Thank you so much.

Best

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.