ZhengPeng7/BiRefNet

Guiding what to segment

hbardak opened this issue · 18 comments

Hi !
Firstly amazing work !
Not really an issue but more a question.

By reading the white paper, I am not sure if you can choose what to segment rather than just the foreground, (a bit like Segment Anything Model).
As I am just an artist, I am not understanding everything.
Could you confirm or deny it ?

Best regards,

Hi, thx for your interest :)
By now, the target to segment can not be specified. What the model should segment is learnt from the dataset (e.g., salient object detection).
However, in my mind, it's easy to do a little modification on the dataset to get boxes of targets, which can be used as a prompt for you to choose which object you want to segment.
Do you have that need? If this is really a useful thing to people like you in development, I can also spare some time to try to do that.

I think that would be useful !

Alright, I'll try to spare some time to give it a try. Updates will be attached here (successful or not), you can wait for it.

Amazing ! Thank you !

any update on this for using a bounding box as input, just like SAM ?

It's still not, but may come out this week.

amazing !