Bug at generate marks about multimodal-maestro HOT 9 OPEN

Hi @jyC23333! 👋🏻 Could you share the code you run and image you used? Basically something more so I can understand better what happens?

from multimodal-maestro.

Hi，@SkalskiP ，my code shows below:

import cv2
import maestro

image = cv2.imread('./鲫鱼.png')

generator = maestro.SegmentAnythingMarkGenerator(device='cuda')
marks = generator.generate(image=image)
marks = maestro.refine_marks(marks=marks)

mark_visualizer = maestro.MarkVisualizer()
marked_image = mark_visualizer.visualize(image=image, marks=marks)

something wrong at this line:

marks = generator.generate(image=image)

original image:

from multimodal-maestro.

Thanks @jyC23333. I'll get back to you!

from multimodal-maestro.

Hi @jyC23333 👋🏻 I just tested using the latest version of maestro, and everything works.

Take a look at this Colab.

Make sure to use the 0.1.1rc1 version. Please let me know if that helped.

from multimodal-maestro.

@SkalskiP Hi，the bug still exists with the latest version.

This is my cuda info:

And I'm using torch 2.1.0:

from multimodal-maestro.

Hi @jyC23333, the bug doesn't exist in the Colab I sent you, so it must be environment-dependent. What version of transformers and supervision you have?

from multimodal-maestro.

@SkalskiP Hi，the dependent info is:

from multimodal-maestro.

To address the bug, add debug logs around self.pipeline in generate to check data shapes and integrity. Monitor GPU usage to ensure no memory overflow—silent issues may not trigger clear error messages

from multimodal-maestro.

I'm very sorry, but I'm extremely busy. I'll try to look at it as soon as possible.

from multimodal-maestro.