Comments (6)
hi!
your model in the canonical pose looks somewhat better than mine, good job.
in her e-mails Mira told me the same number of iterations till convergence. indeed, when running my code, warp for some of the voxels never really converges. the most troublesome area for me seems to be the voxels at the sdf truncation boundary.
i do think that 30-150 gradient descent iterations to guarantee convergence sounds very optimistic. i also don't really know why i wasn't able to exactly reproduce the results from the paper and i'd be really happy to learn what the problem is and fix it
from sobfu.
P.S. ultimately related to #1
from sobfu.
Sure, I'm available for any correspondence regarding this now or in the future. TBH, Mira didn't sound completely sure in her emails about what was going on in her code, and some of the statements she made seem contradictory to the math given in the papers.
I'll take a deeper debug through your code later on and see if I notice anything that doesn't mesh with what I have. Maybe we could improve each-other's code. I wouldn't say that my result is better -- I used the masked version of the Snoopy sequence (masks as provided from Mira's website). Also, for some reason, the InfiniTAM rigid alignment / tracking that I used instead of Mira's SDF-2-SDF algorithm fails horribly beyond the first hundred frames (hence the result I give is only to frame 65).
I'm working on an alternative hierarchical schema and some more advanced filtering technique (than conventional bilateral filter) for the input data, the result is open source in one of my repos, and I'll let you know if I ever get anywhere with that.
from sobfu.
Hi @Algomorph,
Thanks a lot for sharing the results. You got a very nice reconstruction! I am trying to re-implement SobolevFusion on InfiniTAM as well, can I ask how many iterations and the step size for this reconstruction? The screenshots are my results after 65 frames and I don't get as good result as yours (I am using 1000 iterations per frame and step size 0.05). I haven't got the sobolev gradient flow implemented so it's just data term and Tikhonov term in L2 space... any comments will be helpful...
from sobfu.
@Ryan-Zirui-Wang , my result was with tikhonov term and sobolev smoothing on and I believe the specific one you're looking ad was done on the CPU with 200 iterations and step size 0.1 and with voxel block hashing. The tikhonov smoothing weight I believe was set to 0.2.
I propose for you to grab my code directly from https://github.com/Algomorph/InfiniTAM by forking & branching and start stripping off dependencies that aren't 100% necessary, like VTK, so you can build it easily. there is a lot of code I used for analysis that should simply be moved to a separate repository.
After this you can merge your code with my implementation (if necessary) to combine your effort with mine. As you know, I'm working on a separate codebase right now, but I can be responsive if you choose to go this route and any issues arise.
P.S. my implementation is in the branch feature/DynamicFusion. I've started on the CUDA implementation before I halted and transitioned to my newer alternative experiment.
from sobfu.
@Algomorph thanks for the input. I'll try your InfiniTAM branch and see what is different
from sobfu.
Related Issues (17)
- The reconstruction effect is not very good. HOT 6
- what's the difference between max_energy and max_voxel_energy? HOT 1
- it doesn't converge HOT 6
- Potential mathmatics error HOT 1
- It seems we do not use any color information as we do in the the paper? And we only get the shape?
- Comple sucessed, but get wrong result HOT 2
- Compilation in Ubuntu 20 fails [solved]
- I can't get most of the datasets
- opencv_viz is required but was not found
- Dependencies versions conflict HOT 21
- Segmentation fault(core dumped) HOT 6
- can you clarify variable names HOT 1
- why 48? HOT 1
- is your Mat4f column major or row major HOT 1
- function get_3d_sobolev_filter is not being used HOT 1
- why applying convolutions to nabla_U?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sobfu.