Why assume the patch have the same depth? about indoor-sfmlearner HOT 6 OPEN

@vvvsice Good question.

It's true that depths around the points are not same. The key idea is to compare patch similarity between different frames. You can also implement this idea in different manner. For example, first project 3D points to different frames and crop a patch around the projected coordinate then calculate the loss. However, this implementation ignore camera rotation while assuming same depth accounts for camera rotation.

from indoor-sfmlearner.

I see, thanks a lot.

from indoor-sfmlearner.

@vvvsice Good question.

It's true that depths around the points are not same. The key idea is to compare patch similarity between different frames. You can also implement this idea in different manner. For example, first project 3D points to different frames and crop a patch around the projected coordinate then calculate the loss. However, this implementation ignore camera rotation while assuming same depth accounts for camera rotation.

Hi,thanks for sharing this excellent work.
Could you please explain "this implementation ignore camera rotation while assuming same depth accounts for camera rotation" in more detail? I'm still confused about this.
Much appreciate.

from indoor-sfmlearner.

@belkahorry For the first one, you always crop a local patch around the projected point. The patch is a regular grid and not dependent on the camera rotation. For the second one, we project a patch (instead of point) with same depth to the other image and the projected patch is not a regular grid anymore and thus depends on camera rotation.

from indoor-sfmlearner.

It's clear,thanks!

from indoor-sfmlearner.

Hi, I'm still a bit confused as to why the regular grid would have a connection to the camera rotation.

from indoor-sfmlearner.