Git Product home page Git Product logo

relative3d's Introduction

3D-RelNet: Joint Object and Relation Network for 3D prediction

Nilesh Kulkarni, Ishan Misra, Shubham Tulsiani, Abhinav Gupta.

Project Page

Teaser Image

Demo and Pre-trained Models

Please check out the interactive notebook suncg, interactive notebook nyu which shows reconstructions using the learned models. To run this, you'll first need to follow the installation instructions to download trained models and some pre-requisites.

Training and Evaluating

To train or evaluate the (trained/downloaded) models, it is first required to download the SUNCG dataset and preprocess the data and download the splits here. Please see the detailed README files for Training or Evaluation of models for subsequent instructions. Please note that these splits are different than the splits used by Factored3d

To train or evaluate on the NYUv2 dataset the (trained/downloaded) models, it is first required to download the NYU dataset and preprocess the data and download the splits here. Please see the detailed README files for Training or Evaluation of models for subsequent instructions.

Citation

If you use this code for your research, please consider citing:


@article{kulkarni20193d,
  title={3D-RelNet: Joint Object and Relational Network for 3D Prediction},
  author={Kulkarni, Nilesh
  and Misra, Ishan 
  and Tulsiani, Shubham
  and Gupta, Abhinav},
  journal={International Conference on Computer Vision (ICCV)}
  year={2019}
}

relative3d's People

Contributors

nileshkulkarni avatar shubhtuls avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar

relative3d's Issues

regarding the visualization?

Can you please let me know can I generate the image that is provided in (b)?
Can you please share the code that is used for visualization/rendering the output results like that

pretrained model

Hi,

I'm trying to download the pre-trained model with the provided script:

wget https://cmu.box.com/s/6bq16zba09rjfezfpflfhepgse0ja9cf

but it didn't return anything, I'm wondering if this link is broken?

Thanks

Could u share the object files for nyuv2 dataset

Hi, Nilesh, Thanks for your work especially for the experiment part. I'm trying to reproduce your work. However, I got stuck in the NYU data part. Specifically, I found the object_obj folder of your project is not provided.

self._obj_loader = nyu_parse.ObjectLoader(osp.join(opts.nyu_dir, 'object_obj'))

After some code checking, I figured out this object mat file names are the same as the work
Support Surface Prediction in Indoor Scenes e.g. bed_14.mat.
However the content of this object is not the same format of your code.
['surfaces', 'comp', '__version__', '__header__', '__globals__']

Missing pretrain model files

Hello,

It seems like the pretrained model files (*.pth) provided in your cachedir.tar.gz download do not match the names specified in your training examples. I am specifically looking for the box3d_base_spatial_mask_common_upsample and dwr_base_spatial_mask_common_upsample specified here for training on NYU.

Thanks

Resource links are unavailable.

Hi,

Thank you for the great work.

I tried to deploy the environment and run the codes, but most of the necessary dependent resources seem not downloadable, like all files under 'https://people.eecs.berkeley.edu/~shubhtuls/'.

Besides, there are some small issues like: pip cannot locate PyMesh2 of version 0.2.1 and yyatg (yatg?)

Could you please provide some help with it? Many thanks.

Could you share all the models for your reproducted baseline

Hello, Nil, Could you share all the models for the results on the table? Specifically, for your reproducted baseline results. I tried to use batch size 24 for baseline reproduction, but can not reproduct your factored3d result. From your link here (now is broken), I can only obtain the following model.
box3d_base_spatial_mask_common_upsample/ dwr_base_spatial_mask_common_upsample/ layout_pred/ nyu_relnet_dwr_pos_ft/ object_autoenc_32/ pretrained_dwr_shape_ft/ suncg_relnet_dwr_pos_ft/
However, from your baseline guideline here, your reproducted baseline models are
box3d_base_factored3d_baseline, dwr_base_factored3d_baseline_ft, box3d_base_factored3d_baseline_nyu, dwr_base_factored3d_baseline_nyu
which are missing.

NYU png files

Hello,

This line requires .png image files from the NYUv2 dataset but the website does not provide png files. Where do you get these .png files or how do you generate them?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.