Final feature validation
Opened this issue · 1 comments
codaich commented
- Test on SLAC, Bodhidharma MIDI, MIDI_Malcolm and MEI test sets.
- Do this for MEI and MIDI (and mixed) inputs.
- Do this for ACE XML, ARFF and CSV outputs.
- Do for all features as well as only for 1-D features.
- Do this windowed and not windowed extraction.
- Verify that all features in manual are being extracted (including the two MEI ones) once and only once.
- Verify that there are the correct number of total features are being extracted.
- Verify that features are being saved in the correct order.
- Verify that feature values are actually being saved under correct feature labels.
- Check feature values for general mathematical reasonableness
- Verify that not getting feature values of NaN, infinity, null or -# (unless there is no better default alternative).
- Verify that there is reasonable variance in the values of each feature.
- Check for massive outliers.
- Check instances with a Range value of 0 (could be OK if only contains unpitched instruments or no notes, but make sure).
- Check a unpitched percussion-only track to make sure that it isn't getting any false pitches (e.g. MIDI_SLAC\Rap - Pop Rap\Run DMC - Sucka MCs.mid).
- Verify that features are being extracted from all input files.
- Check for error messages thrown by jSymbolic.
- Check feature files have correct number of instances (i.e. no missed exceptions).
- Verify that feature values are musicologically correct.
- Make sure manual descriptions were correctly interpreted
- Compare to old jSymbolic1 feature results to new jSymbolic2 values
- Will need to hand cacluculate feature values from custom MIDI amd MEI files in order to verify them all
codaich commented
Also run unit tests.