readium/architecture

Building a shared set of manual tests

mickael-menu opened this issue · 1 comments

While we should strive to cover properly the projects with automated tests, it could be useful to have a sequence of manual tests to make sure that everything is working fine in the apps as well. This would help avoid this kind of oversight.

I guess @aferditamuriqi has a private test suite to prepare the master releases, but having a shared test suite could help catch issues early for impacting PRs.

This could be used to externalize testing to free up valuable engineering time as well.

The test suite could be a fillable Google Spreadsheet with a summary page to track the progress. It would contain detailed steps, such as "go 4 pages backward by tapping the left side of the screen and compare to this screenshot", not just "test book.epub".
The spreadsheet would be read-only, but a tester would make a copy of it, tag it with the date, the tested platform and the commit hash of the tested version.

I built it, feel free to contact me on Slack to get access to the test suite.