Regression test overwriting

Question

Regression test overwriting

Closed this issue 7 months ago · 3 comments

We need to decide on how we will deal with regression test assets changing in PROCESS.

I believe we could have a GitHub workflow that overwrites and commits the test assets to the branch before merging?

Answer 1 · 2024-02-01T16:34:09.000Z

Possibly running a pipeline on workflow approval would work. This would then commit back to the branch (🤢) with an overwrite of the reference files. This would cause another run of the workflow that, this time, wont need to run the overwriting job

Answer 2 · 2024-02-01T16:53:57.000Z

I have added a merge requirement that the tests must all be passing before merge which will require a failing regression test is corrected before a merge is allowed. This does not guarantee that changes on main won't still break the regression tests, but its a start?

Answer 3 · 2024-02-21T15:55:29.000Z

Closing in favour of #2915