Can't run demo with provided instructions about romp HOT 20 CLOSED

Q-Q. Sorry, this is out of my knowledge.
Please consider to put this issue on vedo github. Don't bother I have put it on here

Hi, wanna ask you a question. Do u know how to show video frame by frame but also in vedo with interactive mode on?

Something like I can switch the camera angle while predict realtime on videos.

from romp.

Sorry for the unpleasant bugs. Please refer to the latest commit. We have change the render imgine for ubuntu to :
''' if 'Ubuntu' in platform.version(): print('In Ubuntu, using osmesa mode for rendering') os.environ['PYOPENGL_PLATFORM'] = 'osmesa' else: print('In other system, using egl mode for rendering') os.environ['PYOPENGL_PLATFORM'] = 'egl' ''' os.environ['PYOPENGL_PLATFORM'] = 'egl'

from romp.

Please let me know if there are any bugs. Besides, we have removed the reliance on the remarkable smplx. Please just uncomment the import smplx to fix the related bugs.

from romp.

Closed without furthur response.

from romp.

Been a bit busy, but just tried it out. Works great now! Thanks for the quick response.

from romp.

Hello, I encountered the same problem as you, but mine cannot be solved, how did you solve it in the end?

from romp.

Sorry, I forget to upload the picture. This is my problem.

from romp.

Please try to simply use :
os.environ['PYOPENGL_PLATFORM'] = 'egl'
like this.

from romp.

from romp.

Traceback (most recent call last):
File "/root/Downloads/SPIN/demo.py", line 115, in
renderer = Renderer(focal_length=constants.FOCAL_LENGTH, img_res=constants.IMG_RES, faces=smpl.faces)
File "/root/Downloads/SPIN/utils/renderer.py", line 16, in init
self.renderer = pyrender.OffscreenRenderer(viewport_width=img_res,
File "/root/anaconda3/lib/python3.9/site-packages/pyrender/offscreen.py", line 31, in init
self._create()
File "/root/anaconda3/lib/python3.9/site-packages/pyrender/offscreen.py", line 149, in _create
self._platform.init_context()
File "/root/anaconda3/lib/python3.9/site-packages/pyrender/platforms/egl.py", line 186, in init_context
self._egl_context = eglCreateContext(
File "/root/anaconda3/lib/python3.9/site-packages/OpenGL/platform/baseplatform.py", line 402, in call
return self( *args, **named )
File "/root/anaconda3/lib/python3.9/site-packages/OpenGL/error.py", line 228, in glCheckError
raise GLError(
OpenGL.error.GLError: GLError(
err = 12297,
baseOperation = eglCreateContext,
cArguments = (
<OpenGL._opaque.EGLDisplay_pointer object at 0x7f340cd11340>,
<OpenGL._opaque.EGLConfig_pointer object at 0x7f340cd113c0>,
<OpenGL._opaque.EGLContext_pointer object at 0x7f340ccdab40>,
<OpenGL.arrays.lists.c_int_Array_7 object at 0x7f340cd114c0>,
),
result = <OpenGL._opaque.EGLContext_pointer object at 0x7f340cd11b40>
)

"egl' cause this...

from romp.

Oh, this seems to be the bug of SPIN. Please consider to ask the authors of SPIN.

from romp.

@Arthur151 switch to egl still get error:

romp/utils/visualization/renderer_pyrd.py", line 79, in __call__
    color, rend_depth = self.renderer.render(scene, flags=pyrender.RenderFlags.RGBA)
  File "/root/anaconda3/lib/python3.9/site-packages/pyrender/offscreen.py", line 86, in render
    self._platform.make_current()
  File "/root/anaconda3/lib/python3.9/site-packages/pyrender/platforms/egl.py", line 196, in make_current
    assert eglMakeCurrent(
  File "/root/anaconda3/lib/python3.9/site-packages/OpenGL/error.py", line 228, in glCheckError
    raise GLError(
OpenGL.error.GLError: GLError(
        err = 12289,
        baseOperation = eglMakeCurrent,
        cArguments = (
                <OpenGL._opaque.EGLDisplay_pointer object at 0x7fb02cb8d7c0>,
                <OpenGL._opaque.EGLSurface_pointer object at 0x7fb0358165c0>,
                <OpenGL._opaque.EGLSurface_pointer object at 0x7fb0358165c0>,
                <OpenGL._opaque.EGLContext_pointer object at 0x7fb02cb8d2c0>,
        ),
        result = 0
)

am runing on a centos server without screen

from romp.

Hi, Jin Tian,
Thanks for your interests in ROMP! I am running ROMP on a centos server too. This Pyrender bug is a tough one. To avoid getting trapped by this bug, latest version of ROMP supports using pytorch3D for rendering. Just switch it to pytorch3D in this config. It is much easier to install.
Feel free to post the bug you meet here. I will response in time.
Best,
Yu

from romp.

@Arthur151 I swithed to pytorch3d and now it render on centos.
pyrender is really buggy, I directly read model file from pkl it can render, but runs on video it can not.. don't know why.

from romp.

Glad to hear that pytorch3d works. I have been confused by pyrender too much times, so do the other developers. I am not a rendering guy. So I can only find some alternative stuff, like maintaining a stable version of pytorch3d.
At my service and keep watching, sir~

from romp.

@Arthur151 BTW, if I set stand on image vis to True, the code coredumped. Do u know why?

from romp.

Yes, I do know why.
Sadly speaking that a server doesn't support (lack some hardwares I guess) the rendering with vtk-tools, like vedo that I use to achieve stand on image vis. So stand on image vis can only run on a desktop with essential visualization hardware.

from romp.

@Arthur151 Also , seems pytorch3d some op doesn't support fp16? Like Meshes class:

File "/root/anaconda3/lib/python3.9/site-packages/pytorch3d/transforms/transform3d.py", line 753, in _broadcast_bmm
    return a.bmm(b)
RuntimeError: expected scalar type Half but found Float

from romp.

Yes, fp16 is some kind of high-level operations. The pytorch3d guies are still busy with implementing some basic function. They may support such high-level operations in the future.

from romp.

@Arthur151 Hi, wanna ask you a question. Do u know how to show video frame by frame but also in vedo with interactive mode on?

Something like I can switch the camera angle while predict realtime on videos.

from romp.