Original datasets:
- Github data: https://github.com/riivo/github-issue-lifetime-prediction
- Public event logs: https://data.4tu.nl/repository/collection:event_logs_real
Preprocessed datasets for predictive process monitoring:
For the preprocessing scripts, see https://github.com/irhete/predictive-monitoring-benchmark
Executing commands for different scripts can be found in the following Jupyter notebook: run_experiments.ipynb
- Hyperparameter optimization
experiments_optimize_params.py
- Training and evaluating final models
experiments.py
- Execution times of final models
experiments_performance.py
- Plots and tables
- Hyperparameter optimization
experiments_optimize_params.py
experiments_optimize_params_with_unstructured_data.py
- Training and evaluating final models
experiments.py
experiments_with_unstructured_data.py
- Execution times of final models
experiments_performance.py
experiments_performance_with_unstructured_data.py
- Plots and tables
generate_latex_tables.ipynb
plot_unstructured_results.R
- Hyperparameter optimization
experiments_optimize_params.py
experiments_optimize_params_with_unstructured_data.py
experiments_optimize_params_lstm.py
experiments_optimize_params_single_multirun.py
- Training final models, calibrating, and writing predictions
experiments_write_predictions_stability.py
experiments_write_predictions_stability_unstructured.py
experiments_write_predictions_lstm.py
- Evaluating prediction accuracy and temporal stability (RQ1)
evaluate_accuracy_stability.ipynb
- Evaluating prediction accuracy and temporal stability of inter-run-optimized models (RQ2)
experiments_test_interrun_stability.py
experiments_test_interrun_stability_unstructured.py
- Applying exponential smoothing (RQ3)
evaluate_accuracy_stability.ipynb
- Plots and tables
generate_latex_tables.ipynb
plot_stability_results.R
- Hyperparameter optimization
experiments_optimize_params.py
experiments_optimize_params_with_unstructured_data.py
- Training final models and writing predictions
experiments_write_predictions_alarms.py
experiments_write_predictions_alarms_unstructured.py
- Optimizing alarm thresholds
experiments_optimize_alarm_threshold.py
experiments_optimize_alarm_threshold_eff.py
experiments_optimize_alarm_threshold_ccom.py
- Evaluating alarming thresholds
experiments_test_fixed_alarm_thresholds.py
(RQ1 baselines)experiments_test_optimal_alarm_threshold.py
(RQ1)experiments_test_optimal_alarm_threshold_eff.py
(RQ2)experiments_test_optimal_alarm_threshold_ccom.py
(RQ3)
- Plots and tables
generate_latex_tables.ipynb
plot_alarm_results.R