/AWESOME-FER

A reading list of top Conferences & Journals, focused on facial expression recognition (FER), facial action unit recognition and affective computing. 💖

🐱FER Datasets

🐱FER Challenges

🐱Related Reviews

🐱Outstanding Researchers Or Groups

🐱Facial Expression Recognition (FER)

🐱Cross-Dataset FER

🐱Facial Action Unit Recognition

🐱Affective Level Estimation

🐱Human Factors on FR or FER

FER Datasets

FER Challenges

Related Reviews

  • (ACM Computing Surveys 19) Facial Expression Analysis under Partial Occlusion: A Survey [paper]
  • (IEEE Transactions on Affective Computing 19) Deep Learning for Human Affect Recognition: Insights and New Developments [paper]
  • (IEEE Transactions on Affective Computing 18) Survey on Emotional Body Gesture Recognition [paper]
  • (IEEE Transactions on Affective Computing 17)Automatic Analysis of Facial Actions: A Survey [paper]
  • (IEEE Transactions on Pattern Analysis and Machine Intelligence 16) Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications[paper]
  • (IEEE Transactions on Pattern Analysis and Machine Intelligence 15) Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition [paper]
  • (Image and Vision Computing 13) Categorical and dimensional affect analysis in continuous input: Current trends and future directions [paper]
  • (FG 11) Emotion representation, analysis and synthesis in continuous space: A survey [paper]
  • Deep Facial Expression Recognition: A Survey [paper]

Outstanding Researchers Or Groups

💫 Outstanding affective computing researchers or groups that are still active in this field, in no particular order.

Facial Expression Recognition

AAAI

  • (2019) Mode Variational LSTM Robust to Unseen Modes of Variation: Application to Facial Expression Recognition [paper]
  • (2019) Semantic Relationships Guided Representation Learning for Facial Action Unit Recognition [paper]
  • (2019) Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation [paper]
  • (2019) CycleEmotionGAN: Emotional Semantic Consistency Preserved CycleGAN for Adapting Image Emotions [paper]
  • (2018) ExprGAN: Facial Expression Editing with Controllable Expression Intensity [paper],[code][:dizzy:]
  • (2018) Learning Spatio-temporal Features with Partial Expression Sequences for on-the-Fly Prediction [paper][:dizzy:]

ACM MM

  • (2018) Fast and Light Manifold CNN based 3D Facial Expression Recognition across Pose Variations [paper]
  • (2018) Facial Expression Recognition in the Wild: A Cycle-Consistent Adversarial Attention Transfer Approach [paper]
  • (2018) Facial Expression Recognition Enhanced by Thermal Images through Adversarial Learning [paper]
  • (2018) Geometry Guided Adversarial Facial Expression Synthesis [paper]
  • (2018) Conditional Expression Synthesis with Face Parsing Transformation [paper]

ICCV

  • (2017) A Novel Space-Time Representation on the Positive Semidefinite Cone for Facial Expression Recognition [paper][:dizzy:]
  • (2017) (workshop) Facial Expression Recognition via Joint Deep Learning of RGB-Depth Map Latent Representations [paper][:dizzy:]
  • (2017) (workshop) Facial Expression Recognition using Visual Saliency and Deep Learning [paper][:dizzy::dizzy:]
  • (2015) Joint Fine-Tuning in Deep Neural Networks for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
  • (2015) Pairwise Conditional Random Forests for Facial Expression Recognition [paper][:dizzy:]

ECCV

  • (2018) Facial Expression Recognition with Inconsistently Annotated Datasets [paper]
  • (2018) Contemplating Visual Emotions: Understanding and Overcoming Dataset Bias [paper]
  • (2018) Deep Multi-Task Learning to Recognise Subtle Facial Expressions of Mental States [paper]
  • (2016) Peak-Piloted Deep Network for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]

CVPR

  • (2019) Learning to Regress 3D Face Shape and Expression from an Image without 3D Supervision [papercode] p- (2018) Facial Expression Recognition by De-expression Residue Learning [paper][:dizzy::dizzy::dizzy:]
  • (2018) Joint Pose and Expression Modeling for Facial Expression Recognition [paper],[code][:dizzy::dizzy:]
  • (2018) 4DFAB: A Large Scale 4D Database for Facial Expression Analysis and Biometric Applications [paper][:dizzy:]
  • (2018) (workshop) Covariance Pooling for Facial Expression Recognition [paper],[code][:dizzy:]
  • (2018) (workshop) Unsupervised Features for Facial Expression Intensity Estimation over Time [paper][:dizzy::dizzy:]
  • (2018) (workshop) A Compact Deep Learning Model for Robust Facial Expression Recognition [paper][:dizzy:]
  • (2017) Reliable Crowdsourcing and Deep Locality-Preserving Learning for Expression Recognition in the Wild [paper][:dizzy:]
  • (2017) Emotion Recognition in Context [paper][:dizzy:]
  • (2017) (workshop) Facial Expression Recognition Using Enhanced Deep 3D Convolutional Neural Networks [paper][:dizzy:]
  • (2017) (workshop) Estimation of Affective Level in the Wild With Multiple Memory Networks [paper][:dizzy::dizzy:]
  • (2017) (workshop) DyadGAN: Generating Facial Expressions in Dyadic Interactions [paper][:dizzy:]
  • (2017) (workshop) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper][:dizzy::dizzy:]
  • (2016) LOMo: Latent Ordinal Model for Facial Analysis in Videos [paper][:dizzy:]
  • (2016) Facial Expression Intensity Estimation Using Ordinal Information [paper],[Supplementary][:dizzy::dizzy:]
  • (2016) EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild [paper],[Supplementary][:dizzy:]
  • (2016) Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis [paper][:dizzy:]
  • (2016) (workshop) Automatic Recognition of Emotions and Membership in Group Videos [paper][:dizzy:]
  • (2016) (workshop) Extended DISFA Dataset: Investigating Posed and Spontaneous Facial Expressions [paper][:dizzy:]
  • (2014) Learning Expressionlets on Spatio-Temporal Manifold for Dynamic Facial Expression Recognition [paper][:dizzy::dizzy:]
  • (2014) Facial Expression Recognition via a Boosted Deep Belief Network [paper][:dizzy:]
  • (2013) Capturing Complex Spatio-Temporal Relations among Facial Muscles for Facial Expression Recognition [paper][:dizzy:]

IJCAI

  • (2018) Personality-Aware Personalized Emotion Recognition from Physiological Signals [paper]
  • (2017) Approximating Discrete Probability Distribution of Image Emotions by Multi-Modal Features Fusion [paper]
  • (2017) Dependency Exploitation: A Unified CNN-RNN Approach for Visual Emotion Recognition [paper]
  • (2017) Joint Image Emotion Classification and Distribution Learning via Deep Convolutional Neural Network [paper]
  • (2016) Multi-View Exclusive Unsupervised Dimension Reduction for Video-Based Facial Expression Recognition [paper]

ICML

  • （2019）A Personalized Affective Memory Model for Improving Emotion Recognition [paper]

BMVC

  • (2018) Feature Selection Mechanism in CNNs for Facial Expression Recognition [paper]

WACV

  • (2016) Going Deeper in Facial Expression Recognition using Deep Neural Networks [paper][:dizzy:]

ICMI

  • (2018) Multi-Feature Based Emotion Recognition for Video Clips [paper]
  • (2018) Video-based Emotion Recognition Using Deeply-Supervised Neural Networks [paper]
  • (2018) Multiple Spatio-temporal Feature Learning for Video-based Emotion Recognition in the Wild [paper]
  • (2018) An Occam’s Razor View on Learning Audiovisual Emotion Recognition with Small Training Sets [paper]
  • (2018) Group-Level Emotion Recognition Using Hybrid Deep Models Based on Faces, Scenes, Skeletons and Visual Attentions [paper]
  • (2018) Cascade Attention Networks For Group Emotion Recognition with Face, Body and Image Cues [paper]
  • (2018) Group-Level Emotion Recognition using Deep Models with A Four-stream Hybrid Network [paper]
  • (2018) An Attention Model for group-level emotion recognition[paper]
  • (2017) Learning supervised scoring ensemble for emotion recognition in the wild [paper]
  • (2017) Convolutional neural networks pretrained on large face recognition datasets for emotion classification from video [paper]
  • (2017) Temporal Multimodal Fusion for Video Emotion Classification in the Wild [paper]
  • (2017) Emotion recognition with multimodal features and temporal models [paper]
  • (2017) Audio-visual emotion recognition using deep transfer learning and multiple temporal models [paper]

FG

  • (2019) Bounded Residual Gradient Networks (BReG-Net) for Facial Affect Computing [paper]
  • (2019) Generalizing to unseen head poses in facial expression recognition and action unit intensity estimation [paper]
  • (2018) Facial Expression Grounded Conversational Dialogue Generation[paper]
  • (2018) Island Loss for Learning Discriminative Features in Facial Expression Recognition [paper]
  • (2018) Multi-Channel Pose-Aware Convolution Neural Networks for Multi-View Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
  • (2018) Automatic 4D Facial Expression Recognition using Dynamic Geometrical Image Network [paper][:dizzy:]
  • (2018) ExpNet: Landmark-Free, Deep, 3D Facial Expressions [paper][code][:dizzy:]
  • (2018) Perceptual Facial Expression Representation [paper][:dizzy:]
  • (2018) Emotion-Preserving Representation Learning via Generative Adversarial Network for Multi-view Facial Expression Recognition [paper][:dizzy::dizzy:]
  • (2018) Spotting the Details: The Various Facets of Facial Expressions [paper][:dizzy:]
  • (2018) Identity-Adaptive Facial Expression Recognition Through Expression Regeneration Using Conditional Generative Adversarial Networks [paper][:dizzy::dizzy::dizzy:]
  • (2018) Hand-crafted Feature Guided Deep Learning for Facial Expression Recognition [paper][:dizzy::dizzy:]
  • (2018) Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition [paper][:dizzy:]
  • (2018) Changes in Facial Expression as Biometric: A Database and Benchmarks of Identification [paper][:dizzy:]
  • (2018) LTP-ML : Micro-Expression Detection by Recognition of Local temporal Pattern of Facial Movements [paper][:dizzy:]
  • (2018) From Macro to Micro Expression Recognition: Deep Learning on Small Datasets Using Transfer Learning [paper][:dizzy:]
  • (2017) Accurate Facial Parts Localization and Deep Learning for 3D Facial Expression Recognition [paper][:dizzy:]
  • (2017) FaceNet2ExpNet: Regularizing a Deep Face Recognition Net for Expression Recognition [paper][:dizzy::dizzy:]
  • (2017) Deep generative-contrastive networks for facial expression recognition [paper][:dizzy::dizzy::dizzy:]
  • (2017) Identity-Aware Convolutional Neural Network for Facial Expression Recognition [paper][:dizzy::dizzy::dizzy:]
  • (2017) (workshop) Spatio-Temporal Facial Expression Recognition Using Convolutional Neural Networks and Conditional Random Fields [paper][:dizzy:]
  • (2017) Head Pose and Expression Transfer using Facial Status Score [paper][:dizzy:]
  • (2017) Sayette Group Formation Task (GFT) Spontaneous Facial Expression Database [paper][:dizzy::dizzy:]
  • (2017) Curriculum Learning for Facial Expression Recognition [paper][:dizzy:]
  • (2017) Implicit Media Tagging and Affect Prediction from RGB-D video of spontaneous facial expressions [paper][:dizzy::dizzy:]
  • (2015) Pairwise Linear Regression: An Efficient and Fast Multi-view Facial Expression Recognition [paper][:dizzy:]

IEEE Trans on Affective Computing

  • (2018) Heterogeneous Knowledge Transfer in Video Emotion Recognition, Attribution and Summarization [paper][:dizzy::dizzy::dizzy:]
  • (2018) Emotion Recognition in Simulated Social Interactions [paper]
  • (2018) Co-clustering to reveal salient facial features for expression recognition[paper]
  • (2018) Facial Expression Recognition with Identity and Emotion Joint Learning [paper]
  • (2018) Unsupervised adaptation of a person-specific manifold of facial expressions [paper][:dizzy::dizzy::dizzy:]
  • (2018) Multi-velocity neural networks for facial expression recognition in videos [paper][:dizzy::dizzy::dizzy:]
  • (2018) Multi-Objective based Spatio-Temporal Feature Representation Learning Robust to Expression Intensity Variations for Facial Expression Recognition [paper]
  • (2018) Visually Interpretable Representation Learning for Depression Recognition from Facial Images [paper][:dizzy::dizzy::dizzy::dizzy:]
  • (2018) An Adaptive Bayesian Source Separation Method for Intensity Estimation of Facial AUs [paper][:dizzy::dizzy::dizzy::dizzy:]
  • (2018) Facial Expression Recognition in Video with Multiple Feature Fusion [paper][:dizzy::dizzy:]
  • (2018) The Indian Spontaneous Expression Database for Emotion Recognition[paper]

IEEE Access

  • (2019) A deep spatial and temporal aggregation framework for video-based facial expression recognition [paper]
  • (2019) cGAN Based Facial Expression Recognition for Human-Robot Interaction [paper]
  • (2018) Geometric-Convolutional Feature Fusion Based on Learning Propagation for Facial Expression Recognition [paper]
  • (2018) Adaptive Feature Mapping for Customizing Deep Learning Based Facial Expression Recognition Model[paper]
  • (2018) Facial Expression Recognition Using Weighted Mixture Deep Neural Network Based on Double-Channel Facial Images [paper]
  • (2018) SMEConvNet: A Convolutional Neural Network for Spotting Spontaneous Facial Micro-Expression From Long Videos [paper]
  • (2018) Dominant and Complementary Emotion Recognition From Still Images of Faces [paper]

IEEE Transactions on Image Processing

  • (2018) Occlusion aware facial expression recognition using CNN with attention mechanism [paper]
  • (2017) Facial Expression Recognition Based on Deep Evolutional Spatial-Temporal Networks [paper]
  • (2013) Simultaneous Facial Feature Tracking and Facial Expression Recognition [paper]
  • (2005) Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences [paper]

Pattern Recognition

  • (2019) Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition [paper][:dizzy::dizzy::dizzy::dizzy:]
  • (2018) Conditional convolution neural network enhanced random forest for facial expression recognition [paper]
  • (2018) Collaborative discriminative multi-metric learning for facial expression recognition in video [paper]
  • (2015) Multimodal learning for facial expression recognition [paper]
  • (2014) Facial expression recognition in dynamic sequences: An integrated approach [paper]

Neurocomputing

  • (2019) Three Convolutional Neural Network Models for Facial Expression Recognition in the Wild [paper]
  • (2019) Cross-domain facial expression recognition via an intra-category common feature and inter-category Distinction feature fusion network [paper]
  • (2018) A visual attention based ROI detection method for facial expression recognition [paper]
  • (2018) Spatio-temporal convolutional features with nested LSTM for facial expression recognition [paper][:dizzy::dizzy::dizzy::dizzy:]
  • (2017) Emotion-modulated attention improves expression recognition: A deep learning model [paper]
  • (2017) An efficient unconstrained facial expression recognition algorithm based on Stack Binarized Auto-encoders and Binarized Neural Networks [paper]

IEEE Transactions on Multimedia

  • (2019) Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks [paper]
  • (2018) MixedEmotions: An Open-Source Toolbox for Multimodal Emotion Analysis [paper]

Computer Vision and Image Understanding

  • (2019) Registration-free Face-SSD: Single shot analysis of smiles, facial attributes, and affect in the wild[paper]

IEEE Transactions on Cybernetics

  • (2015) Learning Multiscale Active Facial Patches for Expression Analysis[paper]

Pattern Recognition Letters

  • (2019) Deep spatial-temporal feature fusion for facial expression recognition in static images [paper]

Others

  • (Neural Networks 2018) Affect recognition from facial movements and body gestures by hierarchical deep spatio-temporal features and fusion strategy [paper]
  • (Journal of Visual Communication and Image Representation 2018) Expression-targeted feature learning for effective facial expression recognition [paper]
  • (IEEE Journal of Selected Topics in Signal Processing 2017) End-to-End Multimodal Emotion Recognition using Deep Neural Networks [paper],[code]

Cross-Dataset FER

  • (Neurocomputing18) Cross-domain Facial Expression Recognition via an Intra-category Common Feature and Inter-category Distinction feature Fusion Network [paper]
  • Cross-database non-frontal facial expression recognition based on transductive deep transfer learning [paper]
  • Unsupervised Domain Adaptation for Facial Expression Recognition Using Generative Adversarial Networks [paper]
  • ICPR 18 Deep Emotion Transfer Network for Cross-database Facial Expression Recognition
  • FG 2018 Deep Unsupervised Domain Adaptation for Face Recognition [paper][:dizzy::dizzy::dizzy:]
  • FG 2018 Cross-generating GAN for Facial Identity Preserving [paper][:dizzy:]
  • ACM MM 2017 Learning a Target Sample Re-Generator for Cross-Database Micro-Expression Recognition [paper][:dizzy:]
  • TIP 2018 Domain Regeneration for Cross-Database Micro-Expression Recognition [paper][:dizzy:]
  • CVPR 2013 Selective Transfer Machine for Personalized Facial Action Unit Detection [paper][:dizzy:]
  • TPAMI 2017 Selective Transfer Machine for Personalized Facial Expression Analysis [paper]
  • ICONIP 2016 Cross-Database Facial Expression Recognition via Unsupervised Domain Adaptive Dictionary Learning [paper](P428)[:dizzy:]
  • IEEE TRANSACTIONS ON AFFECTIVE COMPUTING 2018 Cross-Domain Color Facial Expression Recognition Using Transductive Transfer Subspace Learning [paper][:dizzy:]
  • FG2018 Unsupervised Domain Adaptation with Regularized Optimal Transport for Multimodal 2D+3D Facial Expression Recognition [paper][:dizzy::dizzy:]
  • ICB2016 Discriminative Feature Adaptation for Cross-Domain Facial Expression Recognition [paper][:dizzy:]
  • ICB2015 A Transfer Learning Approach to Cross-Database Facial Expression Recognition [paper][:dizzy:]
  • ICRA2011 Cross-dataset facial expression recognition [paper][:dizzy:]
  • Neurocomputing2016 Transfer subspace learning for cross-dataset facial expression recognition [paper][:dizzy:]
  • IEEE TRANSACTIONS ON MULTIMEDIA 2016 A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition [paper](Cross-view facial expression recognition)[:dizzy:]
  • CVPR2014 Constrained Deep Transfer Feature Learning and its Applications [paper](Cross-view facial expression recognition)[:dizzy:]
  • IEEE SIGNAL PROCESSING LETTERS 2016 Cross-Corpus Speech Emotion Recognition Based on Domain-Adaptive Least-Squares Regression [paper][:dizzy:]
  • ICMI2017 Cross-Modality Interaction between EEG Signals and Facial Expression [paper][:dizzy:]
  • ACM MM 2017 Integrated Face Analytics Networks through Cross-Dataset Hybrid Training[paper][:dizzy::dizzy:]

Facial Action Unit Recognition

CVPR

  • (2018) Weakly-supervised Deep Convolutional Neural Network Learning for Facial Action Unit Intensity Estimation [paper]
  • (2018) Learning Facial Action Units from Web Images with Scalable Weakly Supervised Clustering [paper]
  • (2018) Classifier Learning with Prior Probabilities for Facial Action Unit Recognition [paper]
  • (2018) Bilateral Ordinal Relevance Multi-instance Regression for Facial Action Unit Intensity Estimation [paper]
  • (2018) Weakly Supervised Facial Action Unit Recognition through Adversarial Training [paper]
  • (2017) Deep Structured Learning for Facial Action Unit Intensity Estimation [paper]
  • (2017) Action Unit Detection with Region Adaptation, Multi-labeling Learning and Optimal Temporal Fusing [paper]
  • (2016) Deep Region and Multi-label Learning for Facial Action Unit Detection [paper] [code] [code2]
  • (2016) Constrained Joint Cascade Regression Framework for Simultaneous Facial Action Unit Recognition and Facial Landmark Detection [paper]
  • (2016) Copula Ordinal Regression for Joint Estimation of Facial Action Unit Intensity [paper] [code]
  • (2015) Latent Trees for Estimating Intensity of Facial Action Units [paper][code]
  • (2015) Joint Patch and Multi-label Learning for Facial Action Unit Detection [paper]
  • (2009) A framework for automated measurement of the intensity of non-posed Facial Action Units [paper]

ICCV

  • (2017) DeepCoder: Semi-parametric Variational Autoencoders for Automatic Facial Action Coding [paper]
  • (2017) Deep Facial Action Unit Recognition from Partially Labeled Data [paper]
  • (2015) Learning to transfer: transferring latent task structures and its application to person-specific facial action unit detection [paper]
  • (2015) Multi-conditional Latent Variable Model for Joint Facial Action Unit Detection [paper]
  • (2015) Confidence Preserving Machine for Facial Action Unit Detection [paper]

ECCV

  • (2018) Deep Structure Inference Network for Facial Action Unit Recognition [paper]
  • (2018) Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment[paper]

ACM MM

  • (2018) Personalized Multiple Facial Action Unit Recognition through Generative Adversarial Recognition Network [paper]

BMVC

  • (2018) Identity-based Adversarial Training of Deep CNNs for Facial Action Unit Recognition [paper]
  • (2018) Joint Action Unit localisation and intensity estimation through heatmap regression [paper] [code] [:dizzy::dizzy::dizzy::dizzy:]

FG

  • (2018) Edge Convolutional Network for Facial Action Intensity Estimation [paper]
  • (2017) Support Vector Regression of Sparse Dictionary-Based Features for View-Independent Action Unit Intensity Estimation [paper]
  • (2017) Pose-independent Facial Action Unit Intensity Regression Based on Multi-task Deep Transfer Learning [paper]
  • (2017) AUMPNet: Simultaneous Action Units Detection and Intensity Estimation on Multipose Facial Images Using a Single Convolutional Neural Network [paper]
  • (2017) EAC-Net: A Region-based Deep Enhancing and Cropping Approach for Facial Action Unit Detection [paper]
  • (2015) Deep Learning based FACS Action Unit Occurrence and Intensity Estimation [paper]
  • (2015) How much training data for facial action unit detection? [paper]
  • (2015) Facial Action Units Intensity Estimation by the Fusion of Features with Multi-kernel Support Vector Machine [paper]
  • (2015) A Unified Probabilistic Framework For Measuring The Intensity of Spontaneous Facial Action Units [paper]

IEEE Transactions on Image Processing

  • (2018) Facial Action Unit Recognition and Intensity Estimation Enhanced Through Label Dependencies [paper]
  • (2017) Learning Bases of Activity for Facial Expression Recognition [paper]
  • (2016) Joint Patch and Multi-label Learning for Facial Action Unit and Holistic Expression Recognition [paper]

IEEE Transactions on Pattern Analysis and Machine Intelligence

  • (2015) Discriminant Functional Learning of Color Features for the Recognition of Facial Action Units and their Intensities [paper]
  • (2015) Context-Sensitive Dynamic Ordinal Regression for Intensity Estimation of Facial Action Units [paper]

IEEE Transactions on Affective Computing

  • (2019) Deep Facial Action Unit Recognition and Intensity Estimation from Partially Labelled Data [paper]
  • (2017) Copula Ordinal Regression Framework for Joint Estimation of Facial Action Unit Intensity[paper]

Pattern Recognition

  • (2017) Feature and label relation modeling for multiple-facial action unit classification and intensity estimation [paper]

Image and Vision Computing

  • (2016) Real-time facial action unit intensity prediction with regularized metric learning [paper]
  • (2012) Regression-based intensity estimation of facial action units [paper]

Journal of Visual Communication and Image Representation

  • (2017) A joint dictionary learning and regression model for intensity estimation of facial AUs [paper]

Others

  • Region-based facial representation for real-time Action Units intensity detection across datasets [paper]
  • (ACII17) Local-Global Ranking for Facial Expression Intensity Estimation [paper]
  • (Pattern Recognition Letters14) Estimating smile intensity: A better way [paper] [:dizzy::dizzy::dizzy::dizzy:]
  • (nccv15) Deep Learning based FACS Action Unit Occurrence and Intensity Estimation [paper]
  • Conditional Adversarial Synthesis of 3D Facial Action Units [paper] [:dizzy::dizzy::dizzy:]
  • (NIPS16) Incremental Boosting Convolutional Neural Network for Facial Action Unit Recognition [paper]
  • (ICIP14) Facial action unit intensity estimation using rotation invariant features and regression analysis [paper]
  • (IEEE Transactions on Cybernetics 16) Intensity Estimation of Spontaneous Facial Action Units Based on Their Sparsity Properties [paper]
  • Projects [Computer Expression Recognition Toolbox] [TAUD 2011] [LAUD 2010] [Openface] [[Openface-Paper](OpenFace: an open source facial behavior analysis toolkit)]

Affective Level Estimation

Dataset

  • AffectNet [Website]
  • (IEEE TRANSACTIONS ON AFFECTIVE COMPUTING) AffectNet: A Database for Facial Expression, Valence, and Arousal Computing in the Wild [paper]
  • EMOTIC dataset [Website]
  • (CVPR17) Emotion Recognition in Context [paper][Supp]
  • (CVPR17 workshop) EMOTIC: Emotions in Context Dataset
  • Aff-Wild DATASET[Website]
  • Deep Affect Prediction in-the-wild: Aff-Wild Database and Challenge, Deep Architectures, and Beyond [paper]
  • (CVPR17 workshop) Aff-Wild: Valence and Arousal ‘in-the-wild’ Challenge [paper]
  • HAPPEI dataset (happiness intensity)
  • DISFA [Website](AUs)
  • (IEEE TRANSACTIONS ON AFFECTIVE COMPUTING13) DISFA: A Spontaneous Facial Action Intensity Database [paper]
  • GENKI-4K [Website](smile&non-smile)
  • Proposed Methods validated using GENKI-4K :
  • (ICCVW17) 95.76 SmileNet: Registration-Free Smiling Face Detection In The Wild [paper][project]
  • (Machine Vision and Applications17) 92.05 Smile detection in the wild with deep convolutional neural networks [paper]
  • (ACPR15) 94.6 Facial smile detection based on deep learning features. [paper]
  • AFFECTIVA-MIT AM-FED [Website](smile&non-smile)
  • Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected In-the-Wild [paper]
  • Binghamton Pittsburgh 4D Spontaneous Expression datase (BP4D) [Website]
  • The UNBC-McMaster Shoulder Pain Expression Archive Database

Challenges

  • Group-level happiness intensity recognition @ EmotiW16 [Website]
  • First Affect-in-the-Wild Challenge [Website]

Related Works

  • (ICMI16) Happiness level prediction with sequential inputs via multiple regressions [paper]
  • (CVPR17 workshop) Estimation of Affective Level in the Wild With Multiple Memory Networks [paper]
  • (ICMI16) Group Happiness Assessment Using Geometric Features and Dataset Balancing [paper]
  • (ICMI17) Group Emotion Recognition with Individual Facial Emotion CNNs and Global Image Based CNNs [paper]
  • Feature Extraction via Recurrent Random Deep Ensembles and its Application in Gruop-level Happiness Estimation [paper]
  • (ICPR18) Deep Spatiotemporal Representation of the Face for Automatic Pain Intensity Estimation [paper]
  • Learning Pain from Action Unit Combinations: A Weakly Supervised Approach via Multiple Instance Learning [paper]
  • (CVPR17) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper]
  • (ICIP17) REGULARIZING FACE VERIFICATION NETS FOR PAIN INTENSITY REGRESSION [paper]
  • (CVPR17 Workshop) Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video [paper]
  • Multi-Instance Dynamic Ordinal Random Fields for Weakly-supervised Facial Behavior Analysis [paper]
  • (FG17) Generic to Specific Recognition Models for Group Membership Analysis in Videos [paper]
  • (Neurocomputing18)Facial expression intensity estimation using Siamese and triplet networks [paper]
  • (Neurocomputing16) A new descriptor of gradients Self-Similarity for smile detection in unconstrained scenarios [paper]
  • (IEEE trans on Affective Computing11) Continuous Prediction of Spontaneous Affect from Multiple Cues and Modalities in Valence-Arousal Space [paper]

Happiness (smile intensity estimation)

  • (IEEE Transactions on Pattern Analysis and Machine Intelligence 09) Toward Practical Smile Detection [paper]
  • (Multimedia Tools and Applications18) Smile intensity recognition in real time videos: fuzzy system approach[paper]
  • (ACM Transactions on Intelligent Systems and Technology18) The Effect of Pets on Happiness: A Large-Scale Multi-Factor Analysis Using Social Multimedia [paper]
  • (ICMSS '17) Happy Index: Analysis Based on Automatic Recognition of Emotion Flow [paper]
  • (ICPR 2012)Group Expression Intensity Estimation in Videos via Gaussian Processes [paper]
  • A Novel Approach to Detect Smile [paper]
  • (ICCV17 Workshop) SmileNet: Registration-Free Smiling Face Detection In The Wild [paper][project]
  • (ACII17) Smiling from Adolescence to Old Age: A Large Observational Study [paper]
  • Deep Convolutional Neural Networks for Smile Recognition [paper]
  • Embedded Implementation of a Deep Learning Smile Detector [paper]
  • Smile detection in the wild based on transfer learning [paper]
  • Appearance-based smile intensity estimation by cascaded support vector machines [paper]
  • Smile detection in the wild with deep convolutional neural networks [paper]
  • Fast and Robust Smile Intensity Estimation by Cascaded Support Vector Machines [paper]

Painful Expression Intensity Estimation

  • (IEEE Transactions on Affective Computing 19) Multi-modal Pain Intensity Recognition based on the SenseEmotion Database [paper]
  • (ICMI17) Cumulative Attributes for Pain Intensity Estimation [paper]
  • (CVPRW16)Recurrent Convolutional Neural Network Regression for Continuous Pain Intensity Estimation in Video[paper][:dizzy::dizzy::dizzy:]
  • (CVPRW15)Pain Recognition using Spatiotemporal Oriented Energy of Facial Muscles[paper]
  • (CVPR17) Personalized Automatic Estimation of Self-reported Pain Intensity from Facial Expressions [paper][:dizzy::dizzy:]
  • (FG15)Weakly Supervised Pain Localization using Multiple Instance Learning [paper]
  • (ICIP17) REGULARIZING FACE VERIFICATION NETS FOR PAIN INTENSITY REGRESSION [paper][code]
  • (ICME13) PAIN DETECTION THROUGH SHAPE AND APPEARANCE FEATURES [paper]
  • (ICPR14) Pain Intensity Evaluation Through Facial Action Units [paper]
  • (ieee trans on affective computing) Automatic Pain Assessment with Facial Activity Descriptors [paper]

Human factors on FR or FER

  • (IEEE Transactions on Biometrics, Behavior, and Identity Science19) Demographic Effects in Facial Recognition and Their Dependence on Image Acquisition: An Evaluation of Eleven Commercial Systems [paper]
  • (IEEE Transactions on Biometrics, Behavior, and Identity Science19) An Experimental Evaluation of Covariates Effects on Unconstrained Face Verification [paper]
  • (Symmetry18) Demographic-Assisted Age-Invariant Face Recognition and Retrieval [paper]
  • (Workshop on Fairness, Accountability, and Transparency in Machine Learning18) InclusiveFaceNet: Improving Face Attribute Detection with Race and Gender Diversity [paper]
  • Probabilistic Attribute Tree in Convolutional Neural Networks for Facial Expression Recognition [paper]
  • (International Journal of Computer Graphics18) Review on the effects of age, gender, and race demographics on automatic face recognition [paper]
  • (ICCV17) Attribute-Enhanced Face Recognition with Neural Tensor Fusion Networks [paper]
  • (ACII17) The effect of personality trait, age, and gender on the performance of automatic speech valence recognition [paper]
  • (Journal of Biometrics & Biostatistics16) Face Verification Subject to Varying (Age, Ethnicity, and Gender) Demographics Using Deep Learning [paper]
  • (IEEE Transactions on Affective Computing13) Facial Expression Recognition Influenced by Human Aging [paper]
  • (IEEE Transactions on Information Forensics and Security12) Face Recognition Performance: Role of Demographic Information [paper]
  • (FG11) Demographic Effects on Estimates of Automatic Face Recognition Performance [paper]
  • (CVPR04) How Features of the Human Face Affect Recognition: a Statistical Comparison of Three Face Recognition Algorithms [paper]

Attention

  • (CVPR19) End-to-End Multi-Task Learning with Attention [paper][code])][:dizzy::dizzy::dizzy:]
  • (ACM MM17) Fine-Grained Recognition via Attribute-Guided Attentive Feature Aggregation [paper]
  • (ACM MM18) visual spatial attention network for relationship detection [paper]
  • (ACM MM18) Attribute-Aware Attention Model for Fine-grained Representation Learning [paper]
  • (ACM MM18) Attention-based Multi-Patch Aggregation for Image Aesthetic Assessment [paper]
  • (ACM MM18) Attention-based Pyramid Aggregation Network for Visual Place Recognition [paper]
  • (CVPR18) Attention-Aware Compositional Network for Person Re-identification [paper]
  • (CVPR18) PiCANet: Learning Pixel-wise Contextual Attention for Saliency Detection [paper]
  • (CVPR18) Emotional Attention: A Study of Image Sentiment and Visual Attention [paper]
  • (CVPR16) Learning Deep Features for Discriminative Localization [paper][code]
  • (CVPR18) Non-local Neural Networks [paper]
  • (ECCV18) Interaction-aware Spatio-temporal Pyramid Attention Networks for Action Classification [paper]
  • (ECCV18) CBAM: Convolutional Block Attention Module [paper]
  • (CVPR18) Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification[paper]
  • (CVPR18) Attention-Aware Compositional Network for Person Re-identification [paper]
  • (ICCV17) A Coarse-Fine Network for Keypoint Localization [paper]
  • Video-based Person Re-identification via 3D Convolutional Networks and Non-local Attention [paper]
  • (AAAI19) Dual Attention Network for Scene Segmentation [paper]
  • (ECCV18) Small-scale Pedestrian Detection Based on Topological Line Localization and Temporal Feature Aggregation [paper]
  • (ECCV2018) CornerNet: Detecting Objects as Paired Keypoints [paper][code]
  • (ECCV2018) DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks [paper]
  • (ECCV18) Video Object Segmentation with Joint Re-identification and Attention-Aware Mask Propagation [paper]
  • (ECCV18) Mancs: A Multi-task Attentional Network with Curriculum Sampling for Person Re-identification [paper]
  • (ECCV18) Deep Imbalanced Attribute Classification using Visual Attention Aggregation [paper]
  • (ECCV18) Deep Adversarial Attention Alignment for Unsupervised Domain Adaptation: the Benefit of Target Expectation Maximization [paper]
  • (ECCV18) Deep Adaptive Attention for Joint Facial Action Unit Detection and Face Alignment [paper]