microsoft/lst-bench

Implement Degradation Metric Calculation for Stability Analysis

ashvina opened this issue · 0 comments

Stability analysis evaluates an LST's ability to sustain performance and efficiency, with minimal degradation, when subjected to regular data updates. This requested feature aims to enable the calculation of the degradation metric by comparing performance and efficiency metric points captured at different time intervals.

Requirements:

  1. Implement an extensible degradation metric calculation algorithm in python so that it can easily be used in notebooks for charts.
  2. Add testing framework
  3. Organize the code in easy to consume project and namespaces