Benchopt is a package to simplify and make more transparent and reproducible the comparisons of optimization algorithms. The Lasso consists in solving the following program:
where
This benchmark can be run using the following commands:
$ pip install -U benchopt $ git clone https://github.com/benchopt/benchmark_lasso $ cd benchmark_lasso/
To demonstrate the use of benchopt, one can run, from the benchmark_lasso folder:
$ benchopt install . -s sklearn -s python-pgd --env $ benchopt run . --config example_config.yml --env
Alternatively, one can use the command line interface to select which problems, datasets and solvers are used:
$ benchopt run -s sklearn -d leukemia --max-runs 10 --n-repetitions 5
Use benchopt run -h for more details about these options, or visit https://benchopt.github.io/api.html.
If you run into some errors when running the examples present in this Readme, try installing the development version of benchopt:
$ pip install -U git+https://github.com/benchopt/benchopt
If issues persist, you can also try running the benchmark in local mode with the -l option, e.g.:
$ benchopt run . -l -s sklearn -d leukemia --max-runs 10 --n-repetitions 10
Note that in this case, only solvers which dependencies are installed in the current env will be run.