/ASL-Recognizer

A simple app that analyses and recognises the alphabet in sign language using machine learning

Primary LanguageSwift

ASL Recognizer

A simple app that analyses and recognises the alphabet in sign language using machine learning

Notion link TestFlight link

asl cover

I trained the model with this dataset of about 80,000 images depicting the american alphabet in sign language. The computer trained the model for about 24h and I got pretty accurate results. Schermata 2022-04-01 alle 16 41 43 Schermata 2022-04-01 alle 16 40 42

Implementation

Download the model

Once the model had finished training I implemented it in Swift, creating a project that received in UIImage processes it with the model and shows the result on screen. available on GitHub.

The frameworks I used

I used AVFoundation as the first framework to start recording in real time and receive frames from the camera. After that, the frames I was receiving from the camera were processed using the model created with machine learning and using the vision framework. Then the whole UI is built using SwiftUI.

frameworks 001

Demo of the app

ASL RECOGNIZER 001

Logo