VisionLearningGroup/DANCE

About the evaluation metric

Closed this issue · 2 comments

Hello, Thanks for your interesting and inspiring work~

Recently, [1] and [2] proposed a new metric, harmonic mean of Known ACC and Unknown ACC, to better evaluate the capability on identifying known samples and unknown samples.

Will you consider reporting the results with this metric? Or could you release the model trained with the proposed method(DANCE) ?.

[1] Learning to Detect Open Classes for Universal Domain Adaptation
[2] On the Effectiveness of Image Rotation for Open Set Domain Adaptation

Hi, I do not plan to release the models. I think it is easy to compute the score from this implementation.

OK, Thanks for your response~