mapping 2Dpoint to 3Dpoint about deepdrr HOT 3 CLOSED

You cannot map a 2D point to a 3D point, due to the projection operation.

You can however map a 2D point to a 3D line. p.backproject(index_from_world) returns the Line3D that corresponds to the pixel.

Alternatively, index_from_world.inv @ p gives the vector along this line. You may then want to use the camera_center_in_world to march along the ray.

from deepdrr.

Now, I have 2D points from two different perspectives (i.e. 2D points obtained from different projection angles). Can I mapped 2Dpoint to 3D lines first, and then calculate the intersection of the two 3D lines to obtain the corresponding 3D points of the 2D points?

from deepdrr.

This is triangulation, and the problem is the two lines aren't guaranteed to intersect. There are lots of solutions to this in the literature, depending on your exact problem. Szeliski's computer vision is a good reference.

from deepdrr.