/Neural-Network-Model-to-decipher-Sign-Language

Build a Neural Network Model using TensorFlow and used it on SIGNS dataset to decipher sign language. The algorithm can recognize a sign representing a figure between 0 and 5

Primary LanguageJupyter Notebook

Neural-Network-Model-to-decipher-Sign-Language

Build a Neural Network Model using TensorFlow and used it on SIGNS dataset to decipher sign language.

  • Training set: 1080 pictures (64 by 64 pixels) of signs representing numbers from 0 to 5 (180 pictures per number).
  • Test set: 120 pictures (64 by 64 pixels) of signs representing numbers from 0 to 5 (20 pictures per number).

Note that this is a subset of the SIGNS dataset. The complete dataset contains many more signs.

Result: The algorithm can recognize a sign representing a figure between 0 and 5 with 71.7% accuracy.

Insights:

  • Model seems big enough to fit the training set well. However, given the difference between train and test accuracy, you could try to add L2 or dropout regularization to reduce overfitting.
  • Think about the session as a block of code to train the model. Each time you run the session on a minibatch, it trains the parameters. In total you have run the session a large number of times (1500 epochs) until you obtained well trained parameters.