Automatic Gaze Analysis: A Survey of Deep Learning based Approaches by Shreya Ghosh, Abhinav Dhall, Munawar Hayat, Jarrod Knibbe and Qiang Ji.
If we miss your work, please let us know and we'll add it.
If you find the survey useful for your research, please consider citing our work:
@article{ghosh2021Automatic,
title={Automatic Gaze Analysis: A Survey of Deep Learning based Approaches},
author={Ghosh, Shreya and Dhall, Abhinav and Hayat, Munawar and Knibbe, Jarrod and Ji, Qiang},
journal={arXiv preprint arXiv:2108.05479},
year={2021}
}
A comparison of gaze datasets with respect to several attributes (i.e. number of subjects (# subjects), gaze labels, modality, headpose and gaze angle in yaw and pitch axis, environment (Env.), baseline method, data statistics (# of data), and year of publication.) The abbreviations used are: In: Indoor, Out: Outdoor, Both: Indoor + Outdoor, Gen.: Generation, u/k: unknown, Seq.: Sequence, VF: Visual Field, EB: Eye Blink, GE: Gaze Event, GBRT: Gradient Boosting Regression Trees, GC: Gaze Communication, GNN: Graph Neural Network and Seg.: Segmentation.
A comparison of gaze analysis methods with respect to registration (Reg.), representation (Represent.), Level of Supervision, Model, Prediction, validation on benchmark datasets (validation), Platforms, Publication venue (Publ.) and year. Here, GV: Gaze Vector, Scr.: Screen, LOSO: Leave One Subject Out, LPIPS: Learned Perceptual Image Patch Similarity, MM: Morphable Model, RRF: Random Regression Forest, AEM: Anatomic Eye Model, GRN: Gaze Regression Network, ET: External Target, FV: Free Viewing, HH: HandHeld Device, HMD: Head Mounted Device, Seg.: Segmentation and GR: Gaze Redirection, LAEO: Looking At Each Other.
A curated list of papers and datsets for various gaze estimation techniques, inspired by awesome-computer-vision. Mostly Recent papers are here.
- Eye Gaze Estimation/Tracking
- Gaze Trajectory
- Gaze Redirection
- Gaze Zone + Driver Gaze
- Gaze and Attention
- Gaze and Interaction
- Uncategorized Papers
- Weakly-Supervised Physically Unconstrained Gaze Estimation - Rakshit Kothari, Shalini De Mello, Umar Iqbal, Wonmin Byeon, Seonwook Park, Jan Kautz (CVPR 2021)
- Goal-Oriented Gaze Estimation for Zero-Shot Learning - Yang Liu, Lei Zhou, Xiao Bai, Yifei Huang, Lin Gu, Jun Zhou, Tatsuya Harada (CVPR 2021)
- GOO: A Dataset for Gaze Object Prediction in Retail Environments - Henri Tomas, Marcus Reyes, Raimarc Dionido, Mark Ty, Jonric Mirando, Joel Casimiro, Rowel Atienza, Richard Guinto (CVPRW 2021)
- PureGaze: Purifying Gaze Feature for Generalizable Gaze Estimation - Yihua Cheng, Yiwei Bao, Feng Lu
- Gaze Estimation with an Ensemble of Four Architectures - Xin Cai, Boyu Chen, Jiabei Zeng, Jiajun Zhang, Yunjia Sun, Xiao Wang, Zhilong Ji, Xiao Liu, Xilin Chen, Shiguang Shan
- The Story in Your Eyes: An Individual-difference-aware Model for Cross-person Gaze Estimation - Jun Bao, Buyu Liu, Jun Yu
- Bayesian Eye Tracking - Qiang Ji, Kang Wang
- Glance-and-Gaze Vision Transformer - Qihang Yu, Yingda Xia, Yutong Bai, Yongyi Lu, Alan Yuille, Wei Shen
- Gaze Estimation using Transformer - Yihua Cheng, Feng Lu
- Self-supervised learning through the eyes of a child.
Emin Orhan, Vaibhav Gupta, Brenden M. Lake - A Coarse-to-Fine Adaptive Network for Appearance-Based Gaze Estimation.
Yihua Cheng, Shiyao Huang, Fei Wang, Chen Qian, Feng Lu - ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation. - Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang , Otmar Hilliges
- Towards End-to-end Video-based Eye-Tracking. - Seonwook Park, Emre Aksan, Xucong Zhang, Otmar Hilliges
- Deep Learning-based Pupil Center Detection for Fast and Accurate Eye Tracking System. - Kang Il Lee, Jung Ho Jeon, Byung Cheol Song
- Unsupervised Representation Learning for Gaze Estimation. - Yu Yu, Jean-Marc Odobez
- Domain Adaptation Gaze Estimation by Embedding with Prediction Consistency. - Zidong Guo, Zejian Yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang
- Offset Calibration for Appearance-Based Gaze Estimation via Gaze Decomposition. - Zhaokang Chen, Bertram Shi
- Gaze Estimation for Assisted Living Environments. - Philipe Ambrozio Dias, Damiano Malafronte, Henry Medeiros, Francesca Odone
- Learning to Detect Head Movement in Unconstrained Remote Gaze Estimation in the Wild. - Zhecan Wang, Jian Zhao, Cheng Lu, Fan Yang, Han Huang, lianji li, Yandong Guo
- Learning-based Region Selection for End-to-End Gaze Estimation. - Xucong Zhang, Yusuke Sugano, Andreas Bulling and Otmar Hilliges
- Low Cost Gaze Estimation: Knowledge-Based Solutions. - Ion Martinikorena, Andoni Larumbe-Bergera, Mikel Ariz, Sonia Porta, Rafael Cabeza, Arantxa Villanueva (2020 IEEE TIP)
- Gaze Estimation by Exploring Two-Eye Asymmetry.- Yihua Cheng, Xucong Zhang, Feng Lu, Yoichi Sato (2020 IEEE TIP)
- Gaze360: Physically Unconstrained Gaze Estimation in the Wild. - Petr Kellnhofer, Adria Recasens, Simon Stent, Wojciech Matusik, Antonio Torralba
- Few-Shot Adaptive Gaze Estimation.
Seonwook Park, Shalini De Mello, Pavlo Molchanov, Umar Iqbal, Otmar Hilliges, Jan Kautz - [Mixed Effects Neural Networks (MeNets) With Applications to Gaze Estimation.] Yunyang Xiong, Hyunwoo J. Kim, Vikas Singh
- Generalizing Eye Tracking With Bayesian Adversarial Learning. Kang Wang, Rui Zhao, Hui Su, Qiang Ji
- Eyemotion: Classifying Facial Expressions in VR Using Eye-Tracking Cameras.
Steven Hickson, Nick Dufour, Avneesh Sud, Vivek Kwatra, Irfan A. Essa - MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation. - Xucong Zhang and Yusuke Sugano and Mario Fritz and Andreas Bulling (2017 IEEE TPAMI)
- InvisibleEye: Mobile Eye Tracking Using Multiple Low-Resolution Cameras and Learning-Based Gaze Estimation. - Marc Tonsen and Julian Steil and Yusuke Sugano and Andreas Bulling
- A low-cost and calibration-free gaze estimator for soft biometrics: An explorative study. - Dario Cazzato and Andrea Evangelista and Marco Leo and Pierluigi Carcagní and Cosimo Distante
- Model-based head pose-free gaze estimation for assistive communication. - Stefania Cristina and Kenneth P. Camilleri
- Fast and accurate algorithm for eye localisation for gaze tracking in low-resolution images.
Anjith George and Aurobinda Routray - Gaze Estimation in the 3D Space Using RGB-D Sensors. - Kenneth A. Funes-Mora and Jean-Marc Odobez
- Appearance-Based Gaze Estimation via Uncalibrated Gaze Pattern Recovery. - Feng Lu and Xiaowu Chen and Yoichi Sato
- Dynamic Fusion of Eye Movement Data and Verbal Narrations in Knowledge-rich Domains.
Ervine Zheng, Qi Yu, Rui Li, Pengcheng Shi, Anne Haake - Neuro-Inspired Eye Tracking With Eye Movement Dynamics. - Kang Wang, Hui Su, Qiang Ji
- CUDA-GR: Controllable Unsupervised Domain Adaptation for Gaze Redirection - Swati Jindal, Xin Eric Wang
- Self-Learning Transformations for Improving Gaze and Head Redirection.
Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, Otmar Hilliges - Photo-Realistic Monocular Gaze Redirection Using Generative Adversarial Networks. - Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges
- Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis.
Yu Yu, Gang Liu, Jean-Marc Odobez
- Driver Gaze Region Estimation Without Using Eye Movement - Lex Fridman and Philipp Langhans and Joonbum Lee and Bryan Reimer
- EyeGAN: Gaze-Preserving, Mask-Mediated Eye Image Synthesis. - Harsimran Kaur, Roberto Manduchi
- "Looking at the Right Stuff" - Guided Semantic-Gaze for Autonomous Driving. - Anwesan Pal, Sayan Mondal, Henrik I. Christensen
- Dual Attention Guided Gaze Target Detection in the Wild - Yi Fang, Jiapeng Tang, Wang Shen, Wei Shen, Xiao Gu, Li Song, Guangtao Zhai
- Connecting What To Say With Where To Look by Modeling Human Attention Traces - Zihang Meng, Licheng Yu, Ning Zhang, Tamara L. Berg, Babak Damavandi, Vikas Singh, Amy Bearman
- Appearance-Based Gaze Estimation Using Attention and Difference Mechanism - Murthy L R D, Pradipta Biswas
- Visual Focus of Attention Estimation in 3D Scene With an Arbitrary Number of Targets - Remy Siegfried, Jean-Marc Odobez
- Augmented saliency model using automatic 3D head pose detection and learned gaze following in natural scenes. - Daniel Parks and Ali Borji and Laurent Itti
- Improving Natural Language Processing Tasks with Human Gaze-Guided Neural Attention.
Ekta Sood, Simon Tannert, Philipp Mueller, Andreas Bulling
- Glance and Gaze: Inferring Action-Aware Points for One-Stage Human-Object Interaction Detection - Xubin Zhong, Xian Qu, Changxing Ding, Dacheng Tao
- Appearance-Based Gaze Estimation With Online Calibration From Mouse Operations. Yusuke Sugano and Yasuyuki Matsushita and Yoichi Sato and Hideki Koike
- Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning - Lifeng Fan, Wenguan Wang, Siyuan Huang, Xinyu Tang, Song-Chun Zhu
- PupilTAN: A Few-Shot Adversarial Pupil Localizer - Nikolaos Poulopoulos, Emmanouil Z. Psarakis, Dimitrios Kosmopoulos
- How is Gaze Influenced by Image Transformations? Dataset and Model. - Zhaohui Che, Ali Borji, Guangtao Zhai, Xiongkuo Min, Guodong Guo, Patrick Le Callet (2020 IEEE TIP) [code]