Striveworks/valor

ENH: Data filtering should affect returned metrics.

Closed this issue · 0 comments

Feature Type

  • Adding new functionality to valor

  • Changing existing functionality in valor

  • Removing existing functionality in valor

Problem Description

Valor Lite retains the metadata for the complete dataset / model. While not incorrect, this leads to null metrics being returned when all groundtruths of a particular label are filtered out.

Feature Description

Instead of returning null metrics, return nothing.

Additional Context

No response