Comments (4)
Hello @HeptagramV ,
If the result from our provided configs for the nerd datasets, e.g., https://github.com/NVlabs/nvdiffrec/blob/main/configs/nerd_gold.json
looks as expected, please consider renaming the issue to clarify that this is an issue related to using flexicubes for isosurfacing.
The following config with flexicubes produced decent results in my test today.
{
"ref_mesh": "data/nerd/moldGoldCape_rescaled",
"random_textures": true,
"isosurface" : "flexicubes",
"iter": 5000,
"save_interval": 100,
"texture_res": [ 1024, 1024 ],
"train_res": [512, 512],
"batch": 8,
"learning_rate": [0.03, 0.005],
"dmtet_grid" : 96,
"mesh_scale" : 2.5,
"kd_min" : [0.03, 0.03, 0.03],
"kd_max" : [0.8, 0.8, 0.8],
"ks_min" : [0, 0.08, 0.0],
"ks_max" : [0, 1.0, 1.0],
"background" : "white",
"display" : [{"bsdf":"kd"}, {"bsdf":"ks"}, {"bsdf" : "normal"}],
"out_dir": "nerd_gold_flexi"
}
from nvdiffrec.
你好 ,
如果我们为书数据集提供的配置的结果,例如,https://github.com/NVlabs/nvdiffrec/blob/main/configs/nerd_gold.json 看起来符合预期,请考虑重命名问题以澄清这是与使用弹性立方体进行等面相关的问题。
以下带有灵活立方体的配置在我今天的测试中产生了不错的结果。
{ "ref_mesh": "data/nerd/moldGoldCape_rescaled", "random_textures": true, "isosurface" : "flexicubes", "iter": 5000, "save_interval": 100, "texture_res": [ 1024, 1024 ], "train_res": [512, 512], "batch": 8, "learning_rate": [0.03, 0.005], "dmtet_grid" : 96, "mesh_scale" : 2.5, "kd_min" : [0.03, 0.03, 0.03], "kd_max" : [0.8, 0.8, 0.8], "ks_min" : [0, 0.08, 0.0], "ks_max" : [0, 1.0, 1.0], "background" : "white", "display" : [{"bsdf":"kd"}, {"bsdf":"ks"}, {"bsdf" : "normal"}], "out_dir": "nerd_gold_flexi" }
Thank you very much for your project and response. I ran with the configuration you provided today and found that the exported grid still has poor performance. Is this because I need to adjust additional settings in the export section?
from nvdiffrec.
I'm not sure what you are using for visualizing the model. Do the images dumped from the nvdiffrec renderer during training look ok? For visualization of the exported models, you need to carefully check that the coordinate frames, material textures and tangent space matches.
We provide a script for this for blender in nvdiffrecmc, https://github.com/NVlabs/nvdiffrecmc#use-the-extracted-3d-models-in-blender and I think that should work also for nvdiffrec.
from nvdiffrec.
I'm not sure what you are using for visualizing the model. Do the images dumped from the nvdiffrec renderer during training look ok? For visualization of the exported models, you need to carefully check that the coordinate frames, material textures and tangent space matches.
We provide a script for this for blender in nvdiffrecmc, https://github.com/NVlabs/nvdiffrecmc#use-the-extracted-3d-models-in-blender and I think that should work also for nvdiffrec.
Thank you for your prompt response. I am very grateful for your help!
I tried to load the model in Blender, and this is the result I achieved:
I am also puzzled that there is a significant difference between the output images and the exported mesh during the training process: in these images, the inner side of this object clearly does not have the rough part in the mesh I obtained, which is as smooth as the result you provided earlier;
from nvdiffrec.
Related Issues (20)
- color noise on texture if use base_mesh HOT 4
- How to generate dmtit file, .obj HOT 1
- Appearance-Aware NeRF Extractor HOT 8
- what is system required HOT 1
- Cannot open file 'python310.lib'
- Help!Why is the resulting mesh of such poor quality HOT 3
- Train datasets
- Not able to learn specular and diffuse properties HOT 1
- What's the purpose of custom mipmap build function. HOT 2
- Add a how to cite! HOT 3
- Large gradient at mesh vertices HOT 1
- JSON parameter optimization for Mesh extraction HOT 2
- what's the poses_bounds.npy's data format HOT 3
- question about code details HOT 2
- is there any way to use multi lights? HOT 2
- How to train from a pre-defined mesh? HOT 2
- Creating a new bsdf_256_256.bin HOT 5
- util.rotate_x seems inverse from gl's right hand rule HOT 1
- Use DMTet on udf. HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from nvdiffrec.