How can I get labels_Delta_.json?
Closed this issue · 2 comments
First, thank you for providing useful dataset and code.
I have tried to get more accurately chunk classification.
and now, I try to evaluate new trained model for spotting task.
but, I couldn't correctly running evaluation code.
Generation of predictions_00_(Argmax/NMS/Center_00.json was success.
but, I can't running 'get_detection_performance_spotting', because labels_Delta_.json files.
I read this comment
#6 (comment)
from closed issues page.
How can I get(or generate?) labels_Delta_.json ??
Thank you.
You can copy the structure from your prediction in the json format, and create the labels_Delta_.json from Labels.json for each delta. Basically, Labels.json is for spotting (single timestamp) while labels_Delta_.json is for activities (start/end timestamp).
Then I used the code from ActivityNet to estimate the mAP with tIoU>0 for each deltas.
Alternatively, look at this repo: https://github.com/cioppaanthony/context-aware-loss there is a function for the spotting evaluation (Average-mAP) that avoid this transformation from spotting to activities.
That was very helpful, thank you.