Event-AHU/COESOT

toolkit results I plot is different with your figures in this repo readme?

Closed this issue · 5 comments

laisimiao commented

I just downlaod you provided tracking results and plot SR, PR, NPR figures. But I find SR figure is same with yours. But PR and NPR values are different?
image
image

Tchuanm commented

Hi, I'm not sure where is the difference. I have run the script again derectly to generate SR/PR. They are the same with the paper. Have you changed some thing?

laisimiao commented

I have found the reason why you plot 0.705 as PR

laisimiao commented

you select the PR with plot Success when ranking_type = 'AUC';
Bu that PR is not correct, you need to select PR when ranking_type = 'threshold';

  • 👍2
  • 👀1
laisimiao commented

so solution is:

COESOT/COESOT_eval_toolkit/Evaluate_COESOT_benchmark_SP_RR_Only.m

Lines 95 to 98 in aa61006

% if strcmp(metric_type, 'error') && strcmp(ranking_type, 'AUC') % for ranking_type = 'AUC'
if strcmp(metric_type, 'overlap') && strcmp(ranking_type, 'threshold') % for ranking_type = 'threshold'
continue;
end

to modify as following:
image

laisimiao commented

我已经加你微信了，因为你qq一直没回我XD

  • 😄1