HumanSignal/label-studio-ml-backend

KeyPoint labels don't automatically merge with SAM-generated masks.

Opened this issue · 0 comments

Hi,

I was able to get the ML backend running and use SAM to interactively generate mask annotations based on keypoint and rectangle inputs. However, when the 'Auto-accept suggestions' option is turned off, the keypoint inputs don't get automatically merged with the SAM-generated mask annotations after I clicked accept. They'd just remain in the Regions window and become part of the inputs to the next predict call.
image

When the 'Auto-accept suggestions' option is on, the keypoint input would automatically merge with the mask.
image

Here's my labeling setup:
image

I'm mostly certain this should not be the expected behavior. Is there anything wrong with how I set up my labels?

Thank you for your time and looking forward to hearing from you.