antoinecarme/pyaf

Release Process : Pre-release Benchmarks

antoinecarme opened this issue · 1 comments

Following #176 and #188 :

Need to update PyAF benchmarks with the results for the next release.

https://github.com/antoinecarme/PyAF_Benchmarks

Some refactoring is needed to automate the benchmark execution and integration.

A better Reporting is also needed.

  1. Add a report about training times and their evolution between the previous releases.
  2. Add a global quality report (MAPE + L1 distribution/quantiles for all releases and all benchmark datasets)
  3. A summary report presenting the results (Jupyter notebook)

Target Release : 2022-07-14

FIXED