Git Product home page Git Product logo

icml2021's Introduction

ICML2021 - On the Effectiveness of Weight-Encoded Neural Implicit 3D Shapes

A neural implicit outputs a number indicating whether the given query point in space is outside, inside, or on a surface. Many prior works have focused on latent-encoded neural implicits, where latent vector encoding a specific shape is also fed as input. While affording latent-space interpolation, this comes at the cost of reconstruction accuracy for any single shape. Training a specific network for each 3D shape, a weight-encoded neural implicits may forgo the latent vector and focus reconstruction accuracy on the details of a single shape. While previously considered as intermediary representation 3D scanning tasks or as a toy-problem leading up to latent-encoding tasks, weight-encoded neural implicits have not yet been taken seriously as a 3D shape representation. In this paper, we establish that weight-encoded neural implicits meet the criteria of a first-class 3D shape representation. We introduce a suite of technical contributions to improve reconstruction accuracy, convergence, and robustness when learning the signed distance field induced by a polygonal mesh --- the de facto standard representation. Viewed as a lossy compression, our conversion outperforms standard techniques from geometry processing. Compared to previous latent- and weight-encoded neural implicits we demonstrate superior robustness, accuracy, scalability, and performance.

In this repo we present a comprehensive package for generating weight-encoded neural implicits from existing mesh formats and visualizing the results through a cuda or eigen based sphere marchers.

We additionally share the weight-encoded neural implicits for the Entirety of the Thingk10k dataset (https://ten-thousand-models.appspot.com/).

Lay of the land

Supplementary.mp4 --> supplementary video visualizing through animations various concepts within the paper.
cudaSDFRenderer/ --> our weight-encoded neural implicit GPU accelerated renderer. Use this for realtime rendering of neural implicits. neuralImplicitTools --> tools for sampling meshes, optimizing weights, marching cubes, and visualizing results. This is a good starting point. thingi10k-weight-encoded --> The entirety of Thingi10k represented in our weight-encoded neural implicit format. (see releases for mesh version for convenience)

Command for impeller.obj Experiment

python trainer.py ../data/impeller/impeller.stl --firstLayerHiddenSize=256 --numLayers=10 --showVis 1 --outputDir  ../results/impeller/ --epochs 6 --batchSize 512 --reconstructionRes 256 --learningRate 0.001 --validationRes 128 --loss l2

For vicis

python trainer.py ../data/vicis/vicis.stl --firstLayerHiddenSize=256 --numLayers=10 --showVis 1 --outputDir  ../results/vicis/ --epochs 6 --batchSize 8152 --reconstructionRes 256 --learningRate 0.001 --validationRes 128 --loss l2

icml2021's People

Contributors

u2ni avatar hardikk13 avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.