Value to determine camera angles about segmentanything3d HOT 5 OPEN

Hi, Indeed, SAM may result in segmentation results with different ranges when separating objects. After roughly reviewing the page, I think you could try bi-directional merging to re-merge these sub-structures. For example, set a fusion strategy that you want to integrate the relevant parts into the largest part. Or, when saving SAM results, try to keep the one with the largest coverage area as much as possible (if it is greater than a certain miou value). Just a small suggestion, which may not be accurate.

from segmentanything3d.

Hi!

1. We use SAM to get the segment on RGB data. If you want to use some other data, maybe you should try if SAM works well either.
2. Sorry, I didn't understand this issue very well. Do you mean the number of RGBDs used to build point clouds?

from segmentanything3d.

Hi yhyang-myron!

1. I got the model to work on non-RGB data as well (although it's not as good), so that point is resolved.

2. Diving deeper into the model, I think this question is irrelevant. Sorry for asking!

I do have one further question though:
I am following this medium post: https://medium.com/@OttoYu/point-cloud-segmentation-with-sam-in-multi-angles-add5a5c61e67
and the end result is a segmentation classification for each point, from each different angle. As you can see however, it segments sub-structures from objects (example: the chapel tower is an individual segment from the total chapel).

How would you go about to re-merge these sub-structures into the final objects, when you don't have a ground truth? Can I use the merging method you use (bi-directional merging) for that?

from segmentanything3d.

Awesome! thank you for the quick and in-depth reply, I'm going to try some stuff out. I'll report back in this thread if we have found a nice (combination) of strategies. Amazing stuff you have made! I enjoy playing around with it.

from segmentanything3d.

Thanks for your interest in our work!

from segmentanything3d.