zkonduit/zkml-framework-benchmarks

ZKML-Framework-Comparisons

Getting started

To run the benchmarks, you need to first install python (version 3.9.18 specifically), rust, rust jupyter kernel, risc0 toolchain, and scarb on your unix-like machine.

First, you will need to install ezkl cli version 7.1.4 which you can do from here

To install the other required dependencies run:

bash install_dep_run.sh

For windows systems, you will need to install the dependencies manually.

For linux systems, you may need to install jq.

sudo apt-get install jq

You may run the following to activate the virtual environment if had been deactivated.

source .env/bin/activate

For linux systems you will also need to set the OS environment variable to linux (default is Mac).

export OS=linux

Finally run this cargo nextest test command to get the benchmarks:

source .env/bin/activate; cargo nextest run benchmarking_tests::tests::run_benchmarks_ --no-capture

The data will stored in a benchmarks.json file in the root directory.

If you run into any issues feel free to open a PR and we will try to help you out ASAP.

Enjoy! :)