This project uses TensorFlow.js' handpose detection model to add motion control to Figma.
Figma plugins don't allow access to the webcam for security reasons so the hands detection is done in a separate web app and the data is sent to the Figma plugin using websockets.
Demo video:
More info in this blog post
For the hand detection:
cd into hand-control-ui and follow the steps in the README.
For the plugin:
Open Figma desktop, Plugins > Development > Import plugin from manifest.json.
The demo has a few layers already added to Figma that are then controlled by hand movements but it is possible to create new layers with gestures as well.