/ASL-Interpreter

Hand tracking module empowered by OpenCV and MediaPy, customized to detect letters via sign language (ASL)

Primary LanguagePythonMIT LicenseMIT

HandTracking (ASL Interpreter)

[23/12/2023] - Present

  • Using OpenCV and MediaPy
test-1.mov

Main Idea

hand-landmarks

image

This module will help interpret these symbols and enable beginners to understand ASL instantly.

After the main ASL interpreter module is complete, I will take this project into the real world and decode ASL via Audio connected to a headset

Progress

  • Main Landmark Decoding Logic Complete
  • Finished assigning Alphabet Landmarks it's correct POI (points of interest) and set up a way to have orientation of the hand be considered (ORT)
  • Testing all characters, I found the program has issues distingishing between gestures that are very similar to eachother but very by lenght between landmarks, especially with C and O. I think calculating the distance between all hand landmarks will be the next step in making the system more precise.