Test all capabilities
nikitawootten-nist opened this issue · 0 comments
nikitawootten-nist commented
User Story:
As a Metaschema XSLT contributor, I need to be able to quickly test all capabilities of the repository so that I can be confident that breakages will not occur.
For now we have broken tests into 3 categories:
- Smoke tests: Test that a pipeline runs and produces output (base sanity check, does not rely on XSpec or any other additional infrastructure)
- Specification tests: Test a given action against tests present in the upstream metaschema repository.
- Unit tests
The documentation generation pipeline (src/document/
) provides an example of how tests could be structured. Tests are run using makefile targets. A top level Makefile (src/Makefile
) runs tests for each capability (defined in src/<capability>/Makefile
)
Goals:
Using the makefile infrastructure prototyped in #3, create smoke, unit, and documentation tests (as appropriate) for the following pieces:
- Converter generation
- Documentation generation (for now smoke tests only)
- Schema generation
- Validation
Also:
- Tests are wired to run on PRs via GitHub actions
Dependencies:
#3 merged
Acceptance Criteria
- A Pull Request (PR) is submitted that fully addresses the goals of this User Story. This issue is referenced in the PR.
- The CI-CD build process runs without any reported errors on the PR. This can be confirmed by reviewing that all checks have passed in the PR.