yuhangzang/OV-DETR

How to know the novel proposals belong to which class?

seanzhuh opened this issue · 0 comments

In your model, you randomly select clip image features according to the proposal's class, however, for novel proposals, we only know they are novel, but we do not know which specific novel class they belong to, did you actually classify these proposals using CLIP? More specifically, how to generate the ``instances_train2017_seen_2_proposal.json'' file that annotates classes even for novel proposals?