Improve testing checklist.
Closed this issue · 0 comments
coledie commented
- Delete pytest requirements(add gym), delete test.conf, update test running docs, remove all NBVAL usage
- Base all tests off custom base class w/ runall functionality - one for modules, one general
- Figure how to make individual implementations support custom testing, eg one base test, each template and selectively super() then append
- Module testing template test each and every module subclass on each base module fn
- All different input schemes from metapath dir skip.
- Ensure all modules pickleable(add to base class and default runall)
- Network - Test different initializations and override orders
- Inputs
- Modifier
- Neuron
- Readout
- Reward
- Synapse
- Weight
- Game(test gym) - Test different initializations and override orders
- RL
- MetaRL
- TrainingLoop - Test different callback passing in methods
- Callback
- Logger, MultiLogger
- Reader, MetaReader - breaks on bool arrays, empty and single item lists
- Sanitize
- Serialize
- Backends
- Series(Mock backend)
- Population(Mock backend)
- GenotypeCache
- CI pipeline w/ 3.7, 3.8 linux - run on merge.
- Make tests a PR requirement.