Performance testing
This repository is to contain software geared to collect performance numbers across the algorithms supported by liboqs at different levels of the software and network stack.
Particularly, measurements will be collected using
- ´liboqs´ library-level performance testing using ´speed_sig´ and ´speed_kem´
- ´openssl´ application-level performance testing using ´speed´
- ´openssl´ "basic network"-level raw handshake performance testing using ´s_time´
- "Simulated"/controlled network-level performance testing
- "Full stack" performance testing using standard client software like ´curl´ and standard server software like ´nginx´.
This repository will not contain tests replicating raw algorithm-level testing as done by Supercop.
All tests are
- packaged into standalone Docker images facilitating execution across different (cloud) platforms and hardware architectures & CPU optimizations
- designed to return JSON output representing current performance numbers that can be stored arbitrarily; initial storage facilities are provided to deposit data into AWS S3.
- to also collect/document performance numbers of classic crypto to permit comparison with PQC algorithms
Wrapper scripts are created to facilitate automatically running these tests on different cloud infrastructures and storing the resulting JSON output.