https://github.com/openai/simple-evals is not installable with pip, this package mitigates that by making it installable and importable.
You can use this package by doing:
pip install git+https://github.com/graphcore-research/package-simple-evals.git