Comments (5)
Hi, Indeed, SAM may result in segmentation results with different ranges when separating objects. After roughly reviewing the page, I think you could try bi-directional merging to re-merge these sub-structures. For example, set a fusion strategy that you want to integrate the relevant parts into the largest part. Or, when saving SAM results, try to keep the one with the largest coverage area as much as possible (if it is greater than a certain miou value). Just a small suggestion, which may not be accurate.
from segmentanything3d.
Hi!
- We use SAM to get the segment on RGB data. If you want to use some other data, maybe you should try if SAM works well either.
- Sorry, I didn't understand this issue very well. Do you mean the number of RGBDs used to build point clouds?
from segmentanything3d.
Hi yhyang-myron!
-
I got the model to work on non-RGB data as well (although it's not as good), so that point is resolved.
-
Diving deeper into the model, I think this question is irrelevant. Sorry for asking!
I do have one further question though:
I am following this medium post: https://medium.com/@OttoYu/point-cloud-segmentation-with-sam-in-multi-angles-add5a5c61e67
and the end result is a segmentation classification for each point, from each different angle. As you can see however, it segments sub-structures from objects (example: the chapel tower is an individual segment from the total chapel).
How would you go about to re-merge these sub-structures into the final objects, when you don't have a ground truth? Can I use the merging method you use (bi-directional merging) for that?
from segmentanything3d.
Awesome! thank you for the quick and in-depth reply, I'm going to try some stuff out. I'll report back in this thread if we have found a nice (combination) of strategies. Amazing stuff you have made! I enjoy playing around with it.
from segmentanything3d.
Thanks for your interest in our work!
from segmentanything3d.
Related Issues (20)
- Can I fetch individual objects from the point cloud using this? HOT 8
- Unable to get access to the database HOT 3
- 2D image number for segment HOT 4
- What the lib "pointops" for HOT 2
- Code error
- Can we determine which color belongs to which class through object detection module? HOT 2
- Visual effect problem
- The final step HOT 1
- can't find intrinsic_depth.txt HOT 2
- Error while running libs\pointops\setup.py HOT 3
- Using Customized Dataset HOT 1
- Can I use the point cloud files generated by colmap to perform segmentation with this model? If so, what data is needed?
- Using SAM3D for Custom Point Clouds via Photogrammetry: Seeking Guidance on Implementation HOT 2
- cannot import open3d
- About Data Structure
- Error when trying to run setup.py, and requirements.txt
- Question Regarding 2D to 3D Mask Projection with Central Pillar Scenario
- How to get SAM Generate Masks HOT 3
- Ground Truth Data HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from segmentanything3d.