Git Product home page Git Product logo

point-transformer-diffusion's Introduction

Point-Transformer-Diffusion

Point Transformer Diffusion (PTD) integrates the standard DDPM, adapted for 3D data, with Point Transformer, a local self-attention network specifically designed for 3D point clouds.

Requirements

Make sure the following environments are installed.

python
torch
tqdm
matplotlib
trimesh
scipy
open3d
einops
pytorch_warmup

You can utilize the yaml file in the requirements folder by

conda env create -f ptd_env.yml 
conda activate ptd_env

, which will take significant time. Then, install pointops by

cd lib/pointops/
python setup.py install
cp build/lib.linux-x86_64-cpython-39/pointops_cuda.cpython-39-x86_64-linux-gnu.so .

Also, install emd for evaluation by

cd metrics/PyTorchEMD/
python setup.py install
cp build/lib.linux-x86_64-cpython-39/emd_cuda.cpython-39-x86_64-linux-gnu.so .

The code was tested on Ubuntu 22.04 LTS and GeForce RTX 3090.

Data

For generation, we use ShapeNet point cloud, which can be downloaded here.

Pretrained models

Pretrained models can be downloaded here.

Training

$ python train_generation.py --category car|chair|airplane

Please refer to the python file for optimal training parameters.

Testing

$ python train_generation.py --category car|chair|airplane --model MODEL_PATH

Results

Evaluation results of the trained models of PTD.

Category Model CD EMD
airplane airplane_2799.pth 74.19 61.48
chair chair_1499.pth 56.11 53.39
car car_2799.pth 56.39 52.69

Visualization of several generated results:

Acknowledgements

DDPM for 3D point clouds: Point-Voxel Diffusion.
Point Transformer:

point-transformer-diffusion's People

Contributors

jxl152 avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.