Eye&Pupil Tracker
Android application able to recognize, with the help of two neural networks, the eyes and pupils of the faces captured by the phone's camera.
Folders
- Android: android application
- CSVConverter: XML generator according to csv fiftyone dataset file
- LabelImgModifier: XML generator according to LabelImage dataset file
- Models: all about neural networks
- Remote_training: tools for neural network training
- Report: Latex Report Pdf + PowerPoint Presentation + Jupyter Notebook
Quick start
- Download the apk file here
- Install it on android device
Overview
- Play game: an easy demo game, a quiz game provided by OpentDB APIs
- Nerd mode (top right): shows all the information acquired from the camera
- Calibration
Play game
In this part moving the eyes you will move the red dot. Moving the red dot over an answer you will confirm it. Enjoy the game
Nerd mode
In this mode pressing the button Start preview the front camera preview will be showed on top of the screen. There is a Switch camera button that allows you to choose between front and main rear camera.
With the button Analyze the eye-tracking starts and the corresponding boxes and labels will be showed, the central slider is usefull for filter the results by accuracy.
With the Eye button the gaze-tracking starts and the result is showed on top of the eye-tracking's results.
Calibration
Authors
- Luigi di Nuzzo @luigidinuzzo
- Daniele Foschi @DaniDF
- Filippo Veronesi @filippoveronesi