/tensorflow-js-unity-tutorial

In-Browser Hand Gesture Recognition for Unity with Fastai and TensorFlow.js

Primary LanguageJupyter NotebookMIT LicenseMIT

Fastai → TensorFlow.js → Unity Tutorial

Tutorial Links

  • Part 1: Train a hand gesture classifier using fastai and export it to TensorFlow.js.
  • Part 2: Create a TensorFlow.js plugin for the Unity game engine.
  • Part 3: Build a Unity project as a WebGL application and host it using GitHub Pages.

In-Browser Demo

GitHub Repository Demo Link
fastai-hand-gesture-classifier-webgl-demo Hand Gesture Classifier

Training Code

Jupyter Notebook Colab         Kaggle        
GitHub Repository Open In Colab Kaggle

Kaggle Datasets

Reference Images


Class Image
call call
dislike dislike
fist  fist
four four
like  like
mute  mute
ok  ok
one  one
palm  palm
peace peace
peace_inverted peace_inverted
rock rock
stop stop
stop_inverted stop_inverted
three three
three2 three2
two_up  two_up
two_up_inverted two_up_inverted