depth file about pose-warping HOT 2 CLOSED

I also found that the scale of the depth value obtained by the midas model greatly affects the warp result. I also want to know how to standardize the scale of the depth value.

from pose-warping.

Yes, the scale is very important in depth-based-warping. The sample image I have provided is rendered by Blender. You can find more details and the full database here.

MiDas, as I understand it, is a mono-depth model i.e. it generates depth from a single image. This is an under-constrained problem and the depths from MiDas can never be fully trusted for the purpose of depth-based-warping. There can be so many scenarios where the image looks the same but the depth could be different.

The best source of depth is from a sensor or depth estimated from a multi-view stereo model such as DPS-net. Note that the scale/units of the depth should be the same as that of the translation vector in the camera extrinsics (4th column - if indexing starts at 1).

from pose-warping.