UoB-HPC/SimEng

Overhaul the Jenkin's test pipeline

Opened this issue · 1 comments

Additional to the current regression testing and performance testing that the Jenkin's pipeline does, it needs to be updated to a) test more benchmakrs, b) ensure said benchmarks are functionally correct, and c) ensure that the pass/fail criteria of performance tests are robust and consistent.

We have also seen unexpected errors and behaviour when running SimEng on different Linux distributions / Operating systems. Hence, the testing that a new PR undergoes should include running tests on multiple operating systems - perhaps via docker instances

This should address issue #36