/hand-pose-ui

A hand-gesture controlled, user interface prototype

Primary LanguageTypeScript

Hand Pose Estimation controlled UI

This project is a prototype of a user interface that can be controlled by hand gestures. It uses the MediaPipe Hand Landmarker task to estimate the hand pose and then uses the landmarks to control the UI.

demo

This repo's initial commit was of my progress as of February 2023. Since then, the MediaPipe team had introduced major updates to their API accessing the hand pose estimation model. I'll be adapting the code then adding more use cases beyond navigation.