Problems with detecting multi-color objects (?)
Closed this issue · 1 comments
Hello once again! I return with another surgical tool that I am unable to segment. The original image and segmentation is shown below:
As you can see, absolutely nothing is detected. In order to make sure that it is not a problem with my CAD model, I masked out the entire tool to make it a single color. See below:
With the same templates, it is suddenly detected. This brings me to the conclusion that it has something to do with the SAM segmentation. I ran the tool through SAM Segment Everything and found this:
I believe the problem is that the tool has multiple colors and is segmented in a fragmented way instead of as an entire tool. Is there some way in this code to have an influence on connecting masks and checking them for a match?
As you mentioned, this issue is more related to SAM segmentation. Therefore, I suggest addressing it with the SAM repo as they should provide you with better advice to resolve it than I can. In the meantime, if there are any questions or concerns regarding matching with CNOS that I can assist with, please feel free to open an issue here.