A simple little crawler which downloads networks from lczero.org, runs it on a series of positions and saves the result into an sqlite3 database.
The dependencies you can install using poetry as follows:
git clone https://github.com/kiudee/lc0crawl.git
cd lc0crawl
poetry install
To create the database.db
file and the jobs for the crawler, use the Jupyter notebook lc0crawl/Jobs_and_Plots.ipynb
:
poetry run jupyter notebook
The crawler itself is contained in lc0crawl/main.py
. It will assume that a lc0pro.exe
exists in the current folder and that a database.db
file already exists. It can be run using:
cd lc0crawl
poetry run main.py
Currently, there are many things hardcoded and could be improved. Pull requests are welcome!