/learnSign

This repository is part of the "learnSign" project that is under development and will be submitted for the award of Degree of Bachelor of Technology in Computer Science and Engineering from Rajasthan Technical University, Kota (India).

Primary LanguagePythonApache License 2.0Apache-2.0

learnSign 2 0

LearnSign

https://img.shields.io/badge/Final--Year--Project-Under--Development-yellow

63 million people identify as deaf or hard of hearing in India. Accessibility has always been a huge problem to learn sign language. The best time to learn a language is as a child, so we aim to target teaching sign language at the root.

Our app, learnSign, is a gamified, e-learning app focused on teaching small children sign language. learnSign uses artificial intelligence to provide instant feedback on hand sign technique and augmented reality for an interactive and kinesthetic learning experience.

Major Features

1. Lessons & Quizzes

The student can learn through our lessons and test their skills with our quizzes. The lessons are easy to understand and the learner can learn kinesthetically with augmented reality. The quizzes use machine learning to detect the signs and provide real-time feedback.

2. Friends & LeaderBoard

We wanted to make sure you can interact and practice with your friends through video call. We believe that socializing and friends is a part of what makes learning fun. The leaderboard is a competitive aspect to encourage children to do their very best.

3. Badges & Prizes

We took into account that kids don't like traditional e-learning as they find it boring, so we gamified it. You can earn badges and prizes by completing lessons and quizzes

4. Vast Library of sign languages

To further develop and maintain our free app, we give the option for users to donate cryptocurrency, a digital payment system that doesn't rely on banks to verify transactions, using a technology called blockchain.

Technologies Used

  1. Material-UI, React, Redux
  2. Node.js, Express.js, REST-API
  3. Tensorflow, OpenCV
  4. MongoDB
  5. Blender 3.4 Alpha
  6. Unity 3D
  7. Unite AR
  8. Figma

Relevant Links:

Figma - https://bit.ly/3is9WEr Presentation - https://bit.ly/3XNTTB9 Video Walkthrough - https://www.youtube.com/watch?v=C_pUfpcD--Y Jira Board - https://learnsign.atlassian.net/jira/software/projects/SS/boards/1 (request access first)