magenta/ddsp-vst

Pitch tracking hiccups

jesseengel opened this issue · 1 comments

The distilled CREPE model we use for pitch tracking is pretty good, but every once and a while it makes a small pitch error "hiccup", usually at the end or beginning of a note. There are several different options to explore for smoothing the pitch output (heuristic filter, low-pass, HMM) each with their own tradeoffs and/or latency.

Why can't we just disable it altogether, have a portamento parameter with adjustable speed, and allow/disallow or enable/disable certain notes? Manual microtonal adjustments would also be great! You know, a typical violin would already have no frets at all, so chromatic auto-tune doesn't really sound natural. Same for the trumpet. Sorry if some or all of these things I listed already exist, but I can't use the plug-in conveniently with a screen reader so it should also be optimized for use with screen readers.