Git Product home page Git Product logo

multi-modal-generation-for-shrec22's Introduction

Introduction

In our paper "SHREC'22: Open-Set 3D Object Retrieval", we have released two datasets for open-set 3D object retrieval. The two datasets are generated based on the Modelnet40 dataset. Here, we release the core code for multi-modal data generation including Voxel Modality Generation, Pointcloud Modality Generation, and 24 Images Modality Generation.

The computed fully datasets can be download here. Examlpe code can be found here.

intro

Settings for generating voxel and pointcloud modalities

Create a virtual environment with command

conda create -n shrec22 python=3.8

Then, activate the environment, and install the following libraries with pip

pip install open3d, Pillow, numpy, rich, scipy

Usage

Run the following code. The generated voxel and pointcloud will be stored in the out direction.

python generate_voxel_pointcloud.py

Settings for generating 24 images modality

  • blender 3.0

Install the PIL library for the inside python in blender. Change the work direction to the direction of the inside python of blender. Then, run the following command:

pip install Pillow

Usage

Open generate_24_images.blend with blender 3.0, then run the code. Then, rendered 24 images can be found in the out folder.

Evaluation

Given a given distance matrix, you can evaluate its mAP, NDCG, ANMRR, NN with functions in the metrics.py.

Citation

@article{feng2022shrec,
  title={SHREC’22 track: Open-Set 3D Object Retrieval},
  author={Feng, Yifan and Gao, Yue and Zhao, Xibin and Guo, Yandong and Bagewadi, Nihar and Bui, Nhat-Tan and Dao, Hieu and Gangisetty, Shankar and Guan, Ripeng and Han, Xie and others},
  journal={Computers \& Graphics},
  year={2022},
  publisher={Elsevier}
}

multi-modal-generation-for-shrec22's People

Contributors

yifanfeng97 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

multi-modal-generation-for-shrec22's Issues

Dataset Download links dead

Hello,

the download links for the two datasets OS-MN40 and OS-MN40-MISS are not working. Could you send me updated links or check the current ones, please? Thanks in advance!
Dennis

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.