Beyond Braille

Steps to run the project:

( In order to run this project on your local environment, you need to have node and npm installed )

  • git clone the repository
  • open the project on your system
  • run "npm i yarn"
  • run "yarn install"
  • let the dependencies install
  • run "yarn start"

Steps to work on the project:

Landing Page

We can navigate to object detection, quiz or game page via the navbar

  • We can also click on the give command button, it starts voice recognition and accepts commands: -- give exam -- detect object -- play game

Quiz/examination page

image

  • We can select options for answers as such image and move to the next and previous questions via the buttons provided down below.
  • We can click on "start voice recognition"
  • it starts listening to our voice, accepted commands being:
  • read question
  • read options
  • next question
  • previous question
  • read option 1
  • read option 2
  • read option 3
  • read option 4
  • select option 1
  • select option 2
  • select option 3
  • select option 4
  • read selected option
  • read all selected options
  • stop

Object Detection Page

image

  • As soon as the page opens up, the camera turns on after loading
  • the system starts detecting whatever is in front of the camera and reads it out loud

Game/Tic Tac Toe Page

image

  • We can start playing by clicking on the boxes image
  • The system will automatically read out which player's turn it is
  • When the game detects a win/tie, a message is popped up as such image
  • We can reset the board by clicking the button
  • We can also use this page using voice recognition by clicking on the start game button
  • The list of commands recognized by the system are as follows:
  • top left / 1
  • top / 2
  • top right / 3
  • left / 4
  • center / 5
  • right / 6
  • bottom left / 7
  • bottom / 8
  • bottom right / 9