Gestures For 3D Space
A Summer of Code project under WnCC IITB for designing both the front and back-end of a real-time gesture detection module. Everything related to the project including notes/implementations and related links to those will be hosted here.
Final Task of One Shot Learning using Siamese Neural Networks.
Real Application of Gesture Model.
Related Links
Progress Report
This is the link to the detailed progress report that will be maintained by me throughout the entire duration of this project, as a roadmap of requirements for this project and also, to keep a track of the resources and references that I'm using in this project. Most of the stuff that are not mentioned in this README can be found in the link above.
Finger Count Recogniser
This is a preliminary model of a Finger Count Recogniser, using the direct video feed of the webcam. This model has been kept simple, with OpenCV as its only dependency, so as to study the comparative improvements in the future models which will be utilising CNNs and other Machine Learning techniques.
Summary Of A Paper Exploring DeConvolutional Networks
Here, you can find my summarized version of this paper, by Matthew D. Zeiler and Rob Fergus from the Dept. of Computer Science, New York University, USA which mainly explores the novel way of Visualizing and Understanding Convolutional Networks through DeConvNets.
Dataset Creator For Hand Gestures
I wrote this OpenCV code to easily and quickly create my own hand-gesture image datasets for this project. It implements background subtraction and binary thresholding and saves both the original colour image with 3 channels and the processed single channel image.
Gesture Detection CNN Models Using Transfer Learning
The above, repo hosts some of the notebooks and stuff that I had created while making the CNN Transfer Learning models for this project.
Trained CNN Model
Here you can find the CNN Model trained for gesture recognition. The notebooks created for training the neural net can be found in the last bullet point.
Gesture Application Model
The above piece of code is an implementation of an on-the-go gesture recognizer using a continuous video input through the webcam feed. To check the practical implications of this model, I added some basic fun-features like using gestures to play and pause videos, change current working application window and some volume modulation features as well. It has PyAutoGUI, OpenCV, Keras and My CNN Model in the last Google Drive Link as its dependencies.
Image Enhancer
This is a PyQt5 based open-source, cross-platform app, developed for upscaling low resolution images upto 4x its initial resolution using SOTA Super Resolution GANs.
Summary Of A Paper Exploring Sliding Windows For Making SOTA CNNs Usable In Real-Time Gesture Detection Module
This is a review of a quite recent paper of 2019 titled “Real-time Hand Gesture Detection and Classification using Convolutional Neural Networks” and it aims to address issues faced by real-time recognition of dynamic hand gestures using state-of-the-art CNNs.
SRS Siamese NN One Shot Learning
This is the SRS Document for the Siamese Neural Network training codes for detecting Hand Gestures with minimal dataset(One Shot Learning).
Siamese Networks for One Shot Learning of Hand Gestures
This repo will house the model training codes and explanations, for building a Siamese Neural Network for Hand Gesture Classification using minimal datasets.
Neural Networks and Deep Learning
This is the link to the heavily related Summer Of Science project that I've taken up alongside my SoC project. It will house all the notes and implementations that I'll create throughout the summer break of 2020 on this topic.
Author
Learning with ❤️ Richeek Das . Copyright 2020