cudaGraphicsGLRegisterImage failed: cudaErrorNotSupported about octopus HOT 6 CLOSED

Please check this issue
pmh47/dirt#16

Paul Henderson (the dirt developer) give me this solution:

I reproduced this on a similar configuration; the issue is indeed with using too much memory. Octopus doesn't use allow_growth, so tensorflow grabs all the GPU memory, which leaves DIRT unable to perform its own small allocations. You can patch octopus with the following:

diff --git a/infer_single.py b/infer_single.py
index bfcb292..3a02d8f 100644
--- a/infer_single.py
+++ b/infer_single.py
@@ -6,6 +6,8 @@ from glob import glob
 from lib.io import openpose_from_file, read_segmentation, write_mesh
 from model.octopus import Octopus
 
+import tensorflow as tf
+
 
 def main(weights, name, segm_dir, pose_dir, out_dir, opt_pose_steps, opt_shape_steps):
     segm_files = sorted(glob(os.path.join(segm_dir, '*.png')))
@@ -14,6 +16,8 @@ def main(weights, name, segm_dir, pose_dir, out_dir, opt_pose_steps, opt_shape_s
     if len(segm_files) != len(pose_files) or len(segm_files) == len(pose_files) == 0:
         exit('Inconsistent input.')
 
+    tf.keras.backend.set_session(tf.Session(config=tf.ConfigProto(gpu_options=tf.GPUOptions(allow_growth=True))))
+
     model = Octopus(num=len(segm_files))
     model.load(weights)

And all works fine at me. Please add this patch to the octopus code for works with GPU cards with more than 10GB memory.

from octopus.

DIRT is not part of this project. Please open a ticket at the DIRT project.
If this option improves this project, please submit a pull request.

from octopus.

The fixes should be made in the Octopus code:

file infer_single.py:

import tensorflow as tf

and add inside main function :

tf.keras.backend.set_session(tf.Session(config=tf.ConfigProto(gpu_options=tf.GPUOptions(allow_growth=True))))

Please read his anwer

I reproduced this on a similar configuration; the issue is indeed with using too much memory. Octopus doesn't use allow_growth, so tensorflow grabs all the GPU memory, which leaves DIRT unable to perform its own small allocations. You can patch octopus with the following:

from octopus.

Please feel free to submit a pull request.

from octopus.

Now all works fine. Thanks!

from octopus.

Now all works fine. Thanks!

hi~ Could you share your pkg version? Are you using tf1.13.1?

from octopus.