V1.0.0 Roadmap

[mmiller-max]

I think we're reasonably close to the TestReports being ready for V1.0.0. Here is an initial list of tasks for discussion.

Functionality

• TestSets that use the for syntax result in multiple testsuites with the same name (will be fixed by testsuite/id below) #56
• Ensure all "required" fields in schema are present in report - main aim is that anything reading there report should have the fields that it expects
  • testcase/time (? this is tricky to fill accurately, could be defaulted) #49
  • testsuite/time (This one we can do accurately by adding functionality to ReportingTestSets) #49
  • testsuite/hostname (can default to localhost) #56
  • testsuite/timestamp #49
• Other schema updates #56
  • testsuite/id should be an int that increments for each test suite #56
  • testsuites doesn't need id #56
• Fix compatibility with CustomTestSets #61

Docs

• Update document examples when all schema updates done #60
• Review docs for grammar/clarity etc #60

CI

• Only test PRs and master, rather than all branches (completed by #52)

Code Hygiene

• Ensure all internal functions have docstrings #58
• Refactor the larger functions in runner, e.g. test! #58
• Split out runtests.jl into different files for different bits of functionality #59
• Move import/using to the TestRepots.jl file #69

Not for V1.0.0

• pass information, relies on updates to Julia
• It would be nice to rely less on Pkg internals, but I'm not sure how possible this is without re-writing lots of it ourselves

[oxinabox]

We have now tagged 1.0