numenta/NAB

How to get Ground Truth time stamp labels from NAB data

Hiteshsaai opened this issue · 0 comments

We are working on a anomaly detector model, and we are using NAB data to evaluate the performance. But we are unclear about how to run the performance metrics to evaluate on the NAB data. For example how to calculate the following ?
Standard Profile
Reward Low FP
Reward Low FN

Do you have any script or CLI tool to run our results on it to get the metrics? Kindly help me out

Below i am attaching sample screenshot of our results for reference, to help us with interpreting with ground truth
column description:

metadata details:
ad_score: 1 or 0 (anomaly or not)
predicted: predicted value for given timestamp
timestamp: timestamp of the record
value: given value
name: dataset name

Screenshot 2023-03-10 at 12 55 47 PM