Add Metric abstraction
Closed this issue · 0 comments
cosmaadrian commented
Currently we save both min, max and instant values for all metrics, with the evaluator name concatenated. It's not ideal, and it's not flexible.
Add a separate class called "Metric", that has a name (f1, acc, etc), a source (the evaluator name, maybe snake-case or a custom one) and the monotonicity (min, max, instant, or any other combination).