trigeorgis/mdm

Questions about the calculation of AUC

D-X-Y opened this issue · 1 comments

D-X-Y commented

Hi Trigeorgis,

Thanks for your code.
I have few questions about your AUC.
In your code,

mdm/mdm_eval.py

Line 130 in fc8d011

auc_at_08 = (errors < .08).mean()

you calculate the auc via (errors < .08).mean()

I think it should be the accuracy of the 0.08 threshold rather than AUC?
Would you mind to let me how to calculate the auc@0.08? Thanks a lot.

Yes, you are correct. That was bad naming on my part. You can use this function to calculate the threshold AUC.

https://github.com/menpo/menpofit/blob/master/menpofit/error/stats.py#L45