/Sign-Language-Recognition-Using-Hand-Gestures-Keras-PyQT5-OpenCV

Academic course work project serving the sign language translator with custom made capability

Primary LanguagePython

Project Title

Sign Language Recognition Using Hand Gestures Keras PyQT5 OpenCV

Getting Started

All the source code is available inside SourceCode Directory. It requires python version 3.6 as to synchronize with tensorflow.

  • Install the required libraries and packages.
  • Build the model with name "ASLModel.h5" using cnn_model.py or give any name just modify the line 38 inside "Dashboard.py"
  • Download winGuiAuto.py and paste under lib->site-packages
  • Start using the application by simply double clicking "Dashboard.py"

Prerequisites

  • python 3.6
  • pyqt5, tkinter
  • keyboard
  • winGuiAuto
  • pypiwin32
  • pyttsx3
  • tensorflow
  • keras
  • scipy
  • opencv
  • qimage2ndarray
  • keras
  • pillow

Installing

Download the software setups and follow the on screen instructions

step 1

Installing python 3.6 can be downloaded from below link

Click here to visit download page

step 2

Installing pyqt5 with the following command

pip install pyqt5

step 3

Installing keyboard with the following command

pip install keyboard

step 4

Downloading winAutoGui.py from the below link, and pasting it to Python installation directory->Lib->Site-Packages
make sure path is registered on system variables.

Click here to visit download page

step 5

Installing win32api,win32con,win32gui with the following command

pip install pypiwin32

step 6

Installing pyttsx3 with the following command

pip install pyttsx3

step 7

Installing tensorflow framework with the following command

python -m pip install tensorflow --trusted-host files.pythonhosted.org --trusted-host pypi.org --trusted-host pypi.python.org

For upgradation use the following command

pip install tensorflow==2.0.0-alpha0

step 8

Installing keras with the following command

pip install keras

Note: (if keras doesnt work just replace keras.model to tensorflow.keras.model and keras.preprocessing to tensorflow.keras.preprocessing on line 37 and 156 respectively)

step 9

Installing PIL with the following command

pip install pillow

step 10

Installing qimage2ndarray with the following command

pip install qimage2ndarrays

step 11

Installing scipy with the following command

pip install scipy

step 12

Installing opencv for python with the following commands

pip install opencv-python==3.4.2.16

pip install opencv-contrib-python==3.4.2.16

Built With

  • Sublime - A sophisticated text editor for code, markup and prose.
  • QT Designer - Qt tool for designing and building graphical user interfaces.

Demonstrations

  • Take a look at the working project demonstration. Click on the image to view the complete video

Sign Language Recognition Using Hand Gestures

Authors

  • Shadab Shaikh - Synopsis preparation, Requirement specification, Detection of object through camera, ASL character generation through hand gestures, Sentence formation, Modelling of project, Exporting content, Custom gesture generation, Gesture viewer, TTS assistance. - shadabsk

  • Obaid Kazi - Requirement specification, Detection of object through camera, ASL character generation through hand gestures, Sentence formation, Exporting content, Integrating modules into GUI, TTS assistance.' - ObaidKazi

  • Mohd Adnan Ansari - Requirement specification, Modelling of project, Creating the complete front end of the application - adnannet8425

Acknowledgments

  • The template of readme.md was taken from PurpleBooth
  • Mr. Muhammed Salman Shamsi Asst. Prof Kalsekar Technical campus - For his guidance
  • Mr. Rupesh Poudel Repo- For his assistance and permission to use his existing application.