fjchange/awesome-video-anomaly-detection

It's better to distinguish "Micro-AUC" and "Macro-AUC"

zugexiaodui opened this issue · 2 comments

In Table "Performance Comparison on ShanghaiTech", the AUC of SSMT is 90.2 as reported in its paper. However, the authors use the so called "Macro-AUC" (https://github.com/lilygeorgescu/AED-SSMTL#evaluation), which is not the way to calculate AUC in other papers. It's better to distinguish the two metrics.
Also, it is not the first time the authers of SSMT use Macro-AUC. In their previous papers, e.g. "Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Video", they use this metric and actually cause unfair comparisons.

Thanks for your advice. I'll try to make the reported results "Micro-AUC", which is used more commonly.

The table has been updated. If any other advice, feel free to raise another issue.