Add automated regression testing
Closed this issue · 2 comments
It's just too often that making a change in DynSem causes regressions. We should have some regression testing automated. The test object language could be SIMPL extended to cover more DynSem features (without those features actually being necessary). This would make for a specification that is not pretty but covers DynSem features. A set of programs that exercise the specification is also required. At testing time we could generate an interpreter and then the programs comparing their expected output.
@eelcovisser says:
@vladvergu We should have multiple Spoofax projects as regression tests. It is now possible to build and tests such projects automatically in the buildfarm. (@dc created some documentation for that, which I cannot easily locate atm.) I’m intending to contribute the metaborg-tiger project for this purpose. However, for testing purposes we should standardize on SPT tests for testing all aspects of language definitions. Hence, we need SPT support for DynSem. (With previous versions of DynSem this worked fine, btw.) Can you work on that (with @vlanting)?
Done.