CUDA does not match blocking stream's device type CPU. about deepdrr HOT 7 CLOSED

Yeah, I am continuing to have issues getting torch and pycuda to play nicely together. The easiest solution so far, if you have the resources for it, is to cordon them off from one another using two GPUs. PyCUDA will by default grab GPU 0, and you can specify `model.to("cuda:1") to tell PyTorch to use the other device. If anyone has better solutions, I'd love to incorporate them.

from deepdrr.

Adding this summary:

• Use import pycuda.autoprimaryctx instead of import pycuda.autoinit, as this uses the existing context. This change has been made in the most recent DeepDRR releases.
• If possible, give PyCuda its own GPU device. By default it will take device 0. You can change the "virtual order" with CUDA_VISIBLE_DEVICES=1,0. The PyTorch model can be directed to a particular device with model.to(torch.device("cuda:1")), for example.
• If not possible, try allocating pytorch tensors, including the model with all backprop, before initializing a DeepDRR projector.
• Consider this related thread on this issue.

from deepdrr.

Running pycuda (which deepdrr depends on) and pytorch at the same time is tricky, as these libraries don't play nicely with one another. If it is feasible, it is usually easier to save images offline for later training.

from deepdrr.

Yes, this is feasible, but it would also be cool to generate training data on the fly.
I receive the same error with the snipped at https://github.com/arcadelab/deepdrr#using-deepdrr-simultaneously-with-pytorch.
So my question is: With which setup did this snipped work?

from deepdrr.

Turns out I cannot import for example Volume from deepdrr or Point3D from deepdrr.geo. Such imports already lead to the error from above.
I would heavily need to refactor my project code to separate deepdrr from the dataset.

from deepdrr.

• pycuda==2018.1.1 seems to work together with torch==1.7.1
• needed to downgrade from torch==1.11.0 to 1.7.1, other combinations did not work
• didn't manage to get pycuda==2021.1 to work with newer versions of torch

from deepdrr.

Closing this issue, as the dev branch has now dropped Pycuda in favor of Cupy across DeepDRR.

from deepdrr.