/beat-pose

Play a Beat Saber clone with hand movements using Tensorflow.js & PoseNet

Primary LanguageJavaScriptGNU General Public License v3.0GPL-3.0

BeatPose

Play a Beat Saber clone with hand movements using Tensorflow.js & Posenet, in the browser! 🎉

Based on the awesome work by Supermedium on the beat saver viewer.

Live demo: https://beat-pose.netlify.com/

Blog post

Demo

Play BeatSaber with hand movements

How to use

  • Visit the live demo
  • Allow access to the webcam
  • Place yourself about 1-2m away from your computer in a place that has enough light.
  • Move your hands to see if the recognition works
  • Start playing and hit beats!

Rules

None! It's not a real game, more of an experiment 🙂.

The only "restriction" is that the left hand can only destroy the red beats and the right hand, the blue beats.

Tech stack

Development

To run locally, clone this repository and run:

npm install
npm run start

Then open localhost:9999 in your browser and the default song should be Bohemian Rhapsody - Queen, but you can search for other songs in the bottom search bar.

Support

These kinds of side projects take me a lot of time so, if you like them, your support would be really appreciated if you want to/can 🙂.

ko-fi