Gesture Based UI Project by Ultan Kearns & Paul Kenny

Produced for Gesture Based UI module in 4th year, (Honours) Software Development, Galway-Mayo Institute Of Technology. Lecturer: Damien Costello Video: https://youtu.be/jgFtwVOeVkg

Premise

This project is based on the popular game Simon which has the player memorise a series of colours creating a pattern which the player must re-enter. This is a gesture based project and will utilise voice recognition. I have modified this application to be hearing based as well as memory based as I am a guitarist and I thought it would be a fantastic idea to use an app that would be beneficial to my playing.

Technical Information

This program was produced using Python and the graphics library Kivy and Python's speech recognition library (SpeechRecognition). This application requires an internet connection as it utilizes Google Speech API.

Why Python

Python is a great programming language which has lots of libraries which can be utilised to create a fully functional gesture based user interface that will feel intuitive to the user.

Running

To run this program you just run the simple command main.py in the project directory.

> git clone https://github.com/Ultan-Kearns/GestureBasedUIProject
> cd GestureBasedUIProject
> python3 main.py

See development wiki page for more.

Notes

Android APK located in the bin folder.