SnapSudoku

Take a picture of a Sudoku and have SnapSudoku solve it for you!

TODO:

Improve algorithm to get better Sudoku Grid extraction, make it more robust against blurs .
Improve empty cell detection. Only a basic logic is used right now.

How to use:

After cloning the repo, in the SnapSudoku directory, enter the following in the Terminal:

python sudoku.py <path-to-input-image>

Note: OpenCV, Numpy for Python must be installed. To install them:

sudo apt-get install python-opencv
pip install numpy

Working:

Here's a Sudoku image from a smartphone:

The current code gives out the following output to the Terminal:

Algorithm

Basic image preprocessing - Thresholding.

Crop out approx. Sudoku puzzle (Largest contour)

Get the grid square vertices: (a better way of doing this is required!)
3.1. Get the largest contour of the image.
3.2. Get the largest bounding rectangle within the contour.
3.3. Compute the grid corners.

Do a Warp perspective on the sudoku image

We will extract cells from this, by slicing the sudoku grid evenly.

Digit isolation in cell is done through a series of steps:
6.1. Extract the largest connected component in the image, giving more priority to the center pixels.
6.2. Removing all major noise in the cell.

Predict Digits using a Neural Network.

The only 3rd party libraries required are OpenCV, Numpy. The Neural Network created was trained with around 250 digits. The constants used in the training phase, the training data-set is in this repository itself.