This repository is a companion page for the submission "Know Your Neighbor: Fast Static Prediction of Test Flakiness".
It contains all the material required for replicating the experiments, including: the algorithm implementation, the datasets and their ground truth, and the scripts for the experiments replication.
It also contains additional material used to investigate the effect of FLAST's parameter on its effectiveness and efficiency.
In order to replicate the experiment follow these steps:
-
Clone the repository:
git clone https://github.com/FlakinessStaticDetection/FLAST
-
The experiments have been run using python3.9.2. You can get the appropriate version for your OS here.
-
Install the additional python packages required:
python3 -m pip install -r requirements.txt
Decompress the dataset:
tar zxvf dataset.tgz
Execute the research questions scripts.
python3 py/eff-eff.py
python3 py/compare-pinto.py
The pseudocode of FLAST is available here.
This is the root directory of the repository. The directory is structured as follows:
FLAST
|
|--- dataset/ Dataset folder, automatically generated after the decompression of `dataset.tgz`.
|
|--- manual-inspection/ Tests considered in the manual inspection.
|
|--- parameters/ The investigation on the effect of FLAST's parameters.
|
|--- pseudocode/ The pseudocode of FLAST.
|
|--- py/ Scripts with FLAST implementation and scripts to run experiments.
|
|--- results/ Folder with the results of the experiments.