/video-to-text-sign-language-translator

video-to-text real time ASL translator

Primary LanguageJavaScript

Real time Sign Language translation using Tensorflow.js

Real time ASL video to text

Running the code

To use the code, first install the JavaScript dependencies by running

npm install

Then start the local budo web server by running

npm start

This will start a web server on localhost:9966.

  1. Allow permission to your webcam and microphone.

  2. Add some words you want to train on.

Reference

To learn more about the classifier used in this repo go to KNN Image Classifier

There is a newer version of this classifier released in the new tensorflow.js which can be found here

Credit where credit is due:

This project is based on a popular project for Alexa Sign Language Translation: https://github.com/shekit/alexa-sign-language-translator.

You can find more info about that in social media, and covered in the press: BBC, Verge, Mashable, Fast Co, Kottke, VentureBeat and NowThis