pytest-slow-first is a pytest plugin that optimizes test suite execution by sorting tests based on their duration from the last run. This ensures that slower tests run first, leading to more efficient utilization of resources when used in conjunction with pytest-xdist.
When running your test suite with this plugin, it saves the duration of each test in a file. On subsequent runs, tests are sorted based on the time they took to execute in the last run. This sorting minimizes the overall test suite execution time.
Running tests with pytest-xdist with multiple workers, evenly distributing slower tests among workers becomes crucial. Without this plugin, the default order may lead to inefficient resource utilization. pytest-slow-first addresses this issue by ensuring that slower tests are evenly distributed, reducing the total execution time.
Consider a test suite with six tests, each taking varying amounts of time to run:
Running this suite with two workers using only pytest-xdist might result in uneven distribution:
However, with pytest-slow-first, the same suite will be executed more efficiently and takes less time to finish, as shown below:
To use pytest-slow-first alongside pytest-xdist, simply add the --slow-first option:
pytest tests --slow-first -n3 # using along side xdistThe plugin initializes by running your suite as usual the first time. On subsequent runs, it sorts tests based on the time taken in the previous run.
The plugin's results file is cumulative. If a test run already exists in the file, its duration will be updated.
By default, the plugin saves test durations in a file named pytest-slow-first.json in the current directory. You can change the location by setting the SLOW_FIRST_PATH environment variable:
export SLOW_FIRST_PATH=/tmp/pytest-slow-first.json pytest --slow-firstYou can install "pytest-slow-first" via pip:
$ pip install pytest-slow-first
Contributions are very welcome. Tests can be run with tox, please ensure
the coverage at least stays the same before you submit a pull request.
Distributed under the terms of the MIT license, "pytest-slow-first" is free and open source software.
If you encounter any problems, please file an issue along with a detailed description.