Striveworks/valor

Issues

• BUG: Object Detection IOU Computation

  #816 opened 2 months ago by czaloom
  0

• BUG: Semantic Segmentation not tracking missing predictions properly.

  #814 opened 2 months ago by czaloom
  0

• ENH: Synthetic Benchmarking

  #812 opened 2 months ago by czaloom
  0

• BUG: ROCAUC is not supported for Binary Classifications

  #780 opened 3 months ago by czaloom
  0

• ENH: Improve Object Detection PR Curve

  #646 opened 3 months ago by czaloom
  0

• BUG: Valor Core Classification Fix Future Warning

  #738 opened 3 months ago by jqu-striveworks
  0

• ENH: Add progress reporting to evaluations.

  #647 opened 3 months ago by czaloom
  0

• ENH: Adjust `ConfusionMatrix` metric.

  #807 opened 3 months ago by czaloom
  0

• BUG: Incorrect F1 reported.

  #808 opened 3 months ago by czaloom
  0

• ENH: Add macro and weighted F1 scores to `valor-lite`.

  #806 opened 3 months ago by czaloom
  0

• BUG: valor_core Average Recall metric does not report correct IoU thresholds.

  #745 opened 3 months ago by czaloom
  0

• BUG: Obj Det confusion matrix OOM

  #792 opened 3 months ago by czaloom
  0

• ENH: Add scores to `PrecisionRecallCurve` in Object Detection

  #795 opened 3 months ago by czaloom
  0

• ENH: Remove metrics_to_return.

  #787 opened 3 months ago by czaloom
  0

• ENH: Object Detection examples in dict format

  #784 opened 3 months ago by czaloom
  0

• BUG: ObjDet finalization slowdown

  #782 opened 3 months ago by czaloom
  0

• BUG: `lite` ROCAUC calcs aren't returning expected values for perfect matches

  #779 opened 3 months ago by ntlind
  1

• Handle bad llm response with retries (llm-guided metrics)

  #743 opened 3 months ago by bnativi
  1

• BUG: Add test to `lite` checking for classification bug

  #763 opened 3 months ago by ntlind
  1

• ENH: ability to add datum metadata after datum creation

  #770 opened 3 months ago by MattMcClainStrive
  0

• BUG: Valor Core Counting Datums with other label keys as true negative

  #739 opened 3 months ago by jqu-striveworks
  2

• BUG: Valor Core mAP is not calculated correctly when there are predictions for a class, but no ground truths

  #736 opened 3 months ago by jqu-striveworks
  2

• BUG: `lite` doesn't count true positives if there is a false positive with an equal score

  #769 opened 3 months ago by ntlind
  1

• ENH: Data filtering should affect returned metrics.

  #766 opened 3 months ago by czaloom
  0

• BUG: `lite` Counts are incorrect for a core test case

  #757 opened 3 months ago by ntlind
  1

• BUG: `lite` AR calculations don't match the API for one test

  #756 opened 3 months ago by ntlind
  1

• BUG: `lite` fails an AP test from `core`, likely due to an issue with selecting the "best pairs"

  #754 opened 3 months ago by ntlind
  0

• BUG: `valor_api.backend.core.label.validate_matching_label_keys` Fails unexpectedly

  #640 opened 4 months ago by czaloom
  1

• ENH: ability to search models and datasets

  #750 opened 4 months ago by MattMcClainStrive
  0

• BUG: Valor Core Detection Incorrectly Assigns True Postives

  #735 opened 4 months ago by jqu-striveworks
  2

• BUG: Valor Core Classification Mislabels Prediction FP, FN, TN for examples.

  #737 opened 4 months ago by jqu-striveworks
  0

• Add smoothing function as a metric parameter for the BLEU text generation metric

  #741 opened 4 months ago by bnativi
  1

• adding support for NLP (?)

  #665 opened 4 months ago by bnativi
  0

• BUG: Filters Documentation not Rendering

  #713 opened 5 months ago by czaloom
  0

• BUG: Valor core classification PR curve computation uses lots of memory

  #712 opened 5 months ago by rsbowman-striveworks
  1

• ENH: add support for semantic segmentation error analysis

  #693 opened 5 months ago by MattMcClainStrive
  0

• ENH: Support vector-valued metadata and relevant filtering operations

  #708 opened 5 months ago by tcoffman-strive
  0

• BUG: `model.get_evaluations` returning empty list

  #699 opened 5 months ago by ekorman
  0

• ENH: Allow Precision and Recall MetricTypes for semantic segmentation

  #683 opened 5 months ago by MattMcClainStrive
  0

• ENH: Add client docs for MultiPolygon

  #681 opened 5 months ago by czaloom
  0

• DOC: add doc for MetricType and allowed values for each TaskType

  #682 opened 5 months ago by MattMcClainStrive
  0

• Add 'memory used' to DatasetSummary

  #669 opened 6 months ago by czaloom
  0

• Optimize ROC AUC Computation

  #666 opened 6 months ago by czaloom
  0

• ENH: Allow Deletion Retry

  #663 opened 6 months ago by czaloom
  0

• BUG: Fix Benchmark Typo

  #656 opened 6 months ago by czaloom
  0

• ENH: Classification PR Curve Docs don't match Implementation

  #649 opened 6 months ago by czaloom
  0

• BUG: Bulk `add_predictions` fails with `DatumAlreadyExistsError` or `AnnotationAlreadyExistsError`

  #639 opened 6 months ago by czaloom
  0

• BUG: Integration Test Fails Randomly

  #653 opened 6 months ago by czaloom
  0

• BUG: `validate_matching_label_keys` accessing data outside of user request scope.

  #644 opened 6 months ago by czaloom
  0

• BUG: Inconsistent evaluation times.

  #641 opened 6 months ago by czaloom
  0