Fix examples
izgzhen opened this issue · 3 comments
Currently, there are a lot of examples that failed cozy, which is a regression. See commented ones in test_examples.sh.
- ztopo-cache
- nonscalar-tuple
- sat4j-literal-storage
- docstring
- openfire-roster
- redmine
- argmin
- rot1
What is going wrong in each case?
A few notes about what to expect:
The case study ones (ztopo-cache, openfire-roster, and sat4j-literal-storage) make references to the projects they belong to and therefore must be compiled by their projects' respective build systems, with all the other project files in place. They are in the examples folder as examples, not as tests, and will not work without a lot more infrastructure.
Some of the new ones (nonscalar-tuple and redmine, maybe) use features that have never been supported, like collections inside of other types like tuples or collections. These aren't really regressions, more like examples that exercise not-yet-implemented functionality.
I see, I think we can have different levels of expectation:
- level 1: don't crash cozy
- level 2: don't crash compiler
- level 3: can be executed
- level 4: functionality validated
currently all examples not commented out can reach level 2, and with a proper driver program like MaxBagMain.java, it might reach level 4.
I think we can be super flexible here, but clarifying this in a CI-backed way would be helpful to users.
What is going wrong in each case?
I will detail the problem of each case in separate issues in coming days