- Please allow for camera access to allow PoseNet to work properly.
- Please wait for around 2-3 seconds for everything to load properly and then click twice on the artboard to play.
- p5.js for drawing objects and playing media file.
- PoseNet for head tracking. In our case, it is tracking the nose.
- Create an
assets
folder which contains a media file of the song you want to visualize to. Example:assets/jingle-bell.mp3
- Edit the
mediaFileType
andmediaFilePath
variables inscript.js
(on top of the file). - Open the
index.html
file on a browser (Preferably Chrome). - Enjoy the visuals!
- There is a little bit of jitter at the beginning of the visualization. The reason is that PoseNet is trying to initialize first to track human face.
- The tracking only works well when we move our head horizontally.