Getting the point clouds out at the right scale about dust3r HOT 4 CLOSED

I guess it should work if you find the right transformation to align to whatever metric prediction you have.
We plan it for the next release yes

from dust3r.

Hello @truncs and thanks for your interest!
Well in general, there is a problem to determine the scale of a scene with photogrammetry methods. Prior information must be leveraged as it cannot be guessed purely from triangulation. If you know the absolute depth of (at least one) view(s), or the scale of an object in the scene, you can use it to correct the output of our method, but this requires manual post-processing and is not part of our default pipeline.
Note that while DUSt3R does not output absolute metric reconstructions, it is theoretically possible to train it to do so, provided the training data is metric. We verified it in our experiments, but an absolute metric DUSt3R is still to be trained and evaluated properly.

from dust3r.

@vincent-leroy Thanks for the prompt reply!
Would it work if get the matched sampled points from stereo images with known baseline?
Are there plans to train a metric DUSt3R and release it?

from dust3r.

Thanks!

from dust3r.