rohitgajawada/Where-are-they-looking-PyTorch

Where are they looking? - Gaze Following via Attention modelling and Deep Learning

Where are they looking?

This repository contains an implementation of the "Where are they looking?" paper by A. Recasens*, A. Khosla*, C. Vondrick and A. Torralba.

Introduction

A deep neural network-based approach for gaze-following automated using a SSD face detector.

Installation

• Pytorch 1.1 & Torchvision

Usage

• First, download pretrained Places365 AlexNet model: https://urlzs.com/ytKK3

• Then run: python3 main.py --data_dir=location to gazefollow dataset --placesmodelpath=location to places365 alexnet model

• Please check out opts.py for other parameter changing.

Contact

Please do get in touch with us by email for any questions, comments, suggestions you have!

• rohit.gajawada@gmail.com
• haard.panchal@students.iiit.ac.in

References

• sfzhang15's SFD detector is used for face detection (https://github.com/sfzhang15/SFD).
• Link to the NIPS 2015 paper from MIT: http://people.csail.mit.edu/khosla/papers/nips2015_recasens.pdf. Please cite them if you decide to use this project for your research.