V3Det/V3Det

Detic Result

Opened this issue · 1 comments

Hi @myownskyW7 @yhcao6 @V3Det We note the paper reported Detic result of

Model Seen AP Unseen AP
Detic 30.2 6.7

which is trained on the base class annotation as noted in the paper, however in the detectron-v3det Detic repository, the performance is

Model Seen AP Unseen AP
CenterNet2 CLIP 28.6 3.0
Detic 28.7 5.6

could you explain the differences

We apologize for an error in our paper where it mistakenly refers to "Unseen AP 6.7"; it should actually be "Unseen AP50". Additionally, the correct Unseen AP for Detic in our version of the paper is 5.2, not the previously stated figure. We have implemented minor modifications to the dataset, evaluation, and implementation aspects of our work. For the latest model performance details, please refer to our GitHub page. An update to the paper with the corrected performance metrics will be made subsequently.