Git Product home page Git Product logo

Comments (13)

MengXinChengXuYuan avatar MengXinChengXuYuan commented on August 19, 2024

One more question, did you used only netural model for all subjects?
I noticed there are only a few frames provided (seems every 8 frames), do we have the rest frames or they just remain unopened?

from humbi.

halcyon370 avatar halcyon370 commented on August 19, 2024

Same problem with hand reconstruction.

from humbi.

MengXinChengXuYuan avatar MengXinChengXuYuan commented on August 19, 2024

@halcyon370 Hi what do you mean by same problem?
The matlab version or you also found that the reconstruction meshes are inaccurate in some cases ?

from humbi.

halcyon370 avatar halcyon370 commented on August 19, 2024

@MengXinChengXuYuan The reconstruction meshes of hand are also inaccurate. I use matlab of version 2018b.
pic1
pic2

from humbi.

MengXinChengXuYuan avatar MengXinChengXuYuan commented on August 19, 2024

@halcyon370 I see!

from humbi.

zhixuany avatar zhixuany commented on August 19, 2024

@MengXinChengXuYuan I think the visualization code itself is good. I will ping Jae Shin to try to address your issue since he was working on SMPL body mesh fitting. But as far as I know, we admit that it is not perfect.

from humbi.

zhixuany avatar zhixuany commented on August 19, 2024

@halcyon370 Similarly, I think the visualization code for hand itself is good. But as you are aware of, for some cases the fitting is not perfect and we will try to correct those cases in next round of refinement.

from humbi.

quyanqiu avatar quyanqiu commented on August 19, 2024

@zhixuany Just curious about your hand fitting procedure,In your paper,you mentioned that you use 2D-3D reprojection error term to reconstruct the MANO hand model,But in your annotation, you provide us 3d keypoints GroundTruth,why you did not use the 3D-3D Euclidean distance error to fit mano, Is that more accurate than your current method?

from humbi.

MengXinChengXuYuan avatar MengXinChengXuYuan commented on August 19, 2024

@zhixuany Actually I think no one can generate perfect smpl params for now, in most cases :p
Thank you for sharing your data, and looking forward to the refinement!

from humbi.

Gorokke avatar Gorokke commented on August 19, 2024

@MengXinChengXuYuan Thanks for having interest in our dataset. The ground-truth that we can perfectly ensure is the "Multiview images". For mesh reconstruction, due to the fitting error (e.g., the error from the 3D keypoint reconstruction propagates to the mesh fitting), it could be inaccurate for some cases. - Jae Shin

from humbi.

zhixuany avatar zhixuany commented on August 19, 2024

@quyanqiu Actually I did "use the 3D-3D Euclidean distance error to fit mano" as you said. In "section 3.3. Hand" of paper we mentioned that "We align the hand model to multiview images by minimizing the Euclidean distance between hand keypoints". Is this sentence somehow misleading?

from humbi.

quyanqiu avatar quyanqiu commented on August 19, 2024

@zhixuany sorry for misunderstanding,When I check the formular in your appendix its truly 3D-3D loss

from humbi.

zhixuany avatar zhixuany commented on August 19, 2024

@quyanqiu No problem. Thanks for being interested in HUMBI~

from humbi.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.