py-econometrics/pyfixest

Re-Organize CI Tests

Closed this issue · 0 comments

s3alfisc commented

CI tests currently run for about one hour, which is way too long.

Some ideas how to reduce testing time:

  1. Add "advanced-tests" that are only run when a comment is placed in the PR. See this DoWhy wfl. For example, we could exclude the plotting / API tests and all tests for summarization from the base CI this way.
  2. Add a workflow with a "nightly build" that runs all CI tests, including the advanced tests. See DoWhy's nightly build.
  3. Potentially, re-evaluate if all tests in test_vs_fixest.py are really needed.
  4. Potentially, the installed environments could be cached?
  5. If only the docs are updated, only rebuild the docs, if only the readme is updated, no tests, etc. EconML has some interesting rules in this regard (link)