/Sign-Sense

Deep Learning and Neural Network based Sign Sense or 'Sign Language' to Speech converter is an desktop app which can detect hand signs in a frame and can convert them to Speech, according to their respective meaning. Opposite to this, it can also recognise your voice and can convert it to sign language.

Primary LanguagePython

Sign-Sense

Deep Learning and Neural Network based Sign Sense is a desktop app made for deaf/ dumb people. This will allow them to talk to anybody rather than just those who can understand their language. There is also a Web version for the same so that app can reach to more people.

Features:

  1. Sign2Speech can detect hand signs in a frame and can convert them to Speech, according to their respective meaning using mediapipe, keras, cv2, numpy, etc.
  2. Opposite to this, Speech2Sign can also recognise your voice and can convert it to sign language using speech recognition and OpenAI's Whisper API. It will show an AI-generated video for the signs detected.