EYH0602/TestEval

Evaluating Python Testing Frameworks on Open-Source Software

TestEval

Evaluating Python Testing Frameworks on Open-Source Software

Usage

Setup

source ./src/env.sh
pip3 install -r requirements.txt
git submodule init
git submodule update

And put your GitHub Personal access tokens in ./oauth.

Download Repos

Get Repo List

python3 src/find_repos.py -o data/meta/oss_fuzz_python.jsonl # find Python repos from OSS-Fuzz
python3 src/check_repo_stats.py -i data/meta/oss_fuzz_python.jsonl -o oss_fuzz_python_filtered.jsonl

Download

cd data && mkdir repos && cd ..
python3 src/download_repos.py -i data/meta/oss_fuzz_python_filtered.json --oroot data/repos

Static Analysis for Predictors

python3 src/static.py -i data/meta/oss_fuzz_python_filtered.json -o output.csv

We have a pre-build dataset on this google drive.