/Augmented-Reality-based-Realtime-Sudoku-Solver

An AR app which reads the Sudoku problem from webcam feed and using computer vision techniques digitize the image through CNN approach , then solves, displays the solution in the same perspective of the input feed , thus implementing AR

Primary LanguagePython

Augmented-Reality-based-Realtime-Sudoku-Solver

An AR program, which reads the Sudoku problem from webcam feed and using computer vision techniques digitize the image through CNN approach , then solves, displays the solution in the same perspective of the input feed , thus implementing Augmented reality

sudoku_thumb

Directions to run the program

  • Firstly make sure u have all the required libs installed from the requirements.txt
  • Traverse your terminal to this folder location.
  • Then , In your terminal type python sudoku_main.py and hit enter

Workflow of prog :

1) Input:

input

its the input raw_img passes to the system through the cam feed

2) Extract and Thresholding sudoku:

thresh
Here the sudoku is extracted , warped and thesholded from the raw_image .this img is then preprocessed and used for grid-extraction


3) grid-extraction and number prediction:

ext_pred
Here ,

  • the left image is collection of all extracted number-img-grids collaged together.
  • the right image is collection of all predicted numbers of the respective grids by the CNN model

4) Solving and updating the sudoku:

solved
After solving , the cropped and warped sudoku is updated with solution.

5) Final Output Image:

output
Here , the solved-cropped sudoku is warped_inversed to the original image in the same perspective

References and Resources: