Confusion about 'transformed_params2depthplussilhouette' function about splatam HOT 3 CLOSED

I think it's related to the render camera setting. The gaussian render Renderer(raster_settings = curr_data['cam'], so the render camera's view is always from the first frame's position (call it as view camera). Usually it's identity, which is easy to understand. But when it's not identity, the depth value from scene to view camera used be adjusted.
I may not express it very well, but I think the key is there is a view camera.

from splatam.

Hi @RPFey, Thanks for your question! @Buffyqsf is right.

The input w2c for the transformed_params2depthplussilhouette function is the first_frame_w2c, the viewing camera. Ideally, if all the poses are with respect to the first frame (as is the case with SplaTAM), the input w2c to the transformed_params2depthplussilhouette function would be identity. However, to make sure the function is general and works with any viewing camera definition, we convert the world frame Gaussians to the viewing camera frame to compute the depth:

from splatam.

Thank you for your replies. It answers my questions !

from splatam.