svsdval/video2midi

Scanning the notes from the upper side of the piano roll

phajiyev opened this issue · 5 comments

There are some Synthesia videos on YouTube which does not have Synthesia's standard piano panel on the bottom (replaced with hands (like this one: https://www.youtube.com/watch?v=gQgb0cK0mcs).

It would be great if this program could have an option to read the notes from the upper side of the piano panel as well.

Ok, i will think about this solution ...

I create a two videos for this problem:

Variant 1
Used a experimental functions to read keys...Black keys may not reading and source video quality may create a noise, So some tweaks for note positions and cleaning midi needed...

https://youtu.be/CF7k9A8Ql7E

Variant 2
All keys on same Y. So when note roll and collide with two keys, some tweaks for note positions and cleaning midi needed...

https://youtu.be/I0hK43OAszE

At the moment, this is the best thing that can be done without using computer vision and deep learning.

Have you tried this solution?

If you have any questions or need for change, let me know.