/Awesome-FAS

Paper collection of about the face anti-spoofing

Awesome-FAS (Face Authentication Security)

A curated list of Face Authentication Security (including face anti-spoofing/face presentation attack/face liveness detection, face attack models, etc.) and related resources. This is inspired by Awesome-deep-vision, Awesome-adversarial-machine-learning, Awesome-deep-learning-papers, Awesome-NAS and Awesome-Pruing

Please feel free to pull requests or open an issue to add papers.

Contents

Databases

Name Release year Attacks Modalities #subjects #videos
Ambient-Flash 2021 2D attacks VIS, additional light flashing
3DMA 2019 3D Mask VIS,NIR 67 genuine + 48masks 920
CASIA-SURF 3D HiFi Mask 2020 3D Mask VIS
CASIA-SURF 3D Mask, paper 2020 3D Mask VIS
CUHK MMLab CelebA-Spoof 2020 2D Print, Replay (Derived from CelbeA dataset) VIS
CASIA-SURF Cross-ethnicity Face Anti-spoofing (CeFA), paper 2019 2D Print, Replay; 3D print, silica gel mask VIS, Depth, Infrared (IR) 8 192
IDIAP WMCA 2019 2D Print, Replay and 3D Rigid Mask, Flexible Mask, Paper Mask attacks VIS, depth, infrared and thermal 72 6716
CASIA-SURF, paper 2018 2D Print/Cut VIS, Depth, Infrared (IR) 1000 21000
IDIAP CSMAD, paper 2018 Custom Silicone Mask Attack VIS, near-infrared (NIR), Thermal from long-wave infrared (LWIR),
ROSE-YOUTU 2018 2D Replay, Print, Paper Mask VIS 25 4225
MSU SiW-M（unavailable now） 2019 2D Replay, Print & 3D Mask VIS
MSU SiW (Spoofing in the Wild) 2018 2D Replay, Print VIS 165 4620
HKBU-MARs 2016 3D MASK VIS 12 1008
OULU-NPU 2017 2D Replay, Print VIS 55 5940
IDIAP Multispectral-Spoof Dataset 2015 2D Print VIS, Near-Infrared 21 4704 images
IDIAP 3D Mask Attack Dataset (3DMAD), paper 2013 3D Mask VIS, Depth 17 255
IDIAP Replay Attack 2012 2D Replay, Print VIS
CASIA MFSD (FASD) 2012 2D Replay, Print VIS 50 600

Learning-based methods

Year 2022

Title Venue Note
Learning Meta Pattern for Face Anti-Spoofing TIFS 2022 MetaPattern
Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofing CVPR 2022 Style transfer
Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofing AAAI 2022 Hypothesis Verification?

Year 2021

Title Venue Note
Asymmetric Modality Translation For Face Presentation Attack Detection TMM 2021
Consistency Regularization for Deep Face Anti-Spoofing ArXiv 2021
Dual-Branch Meta-learning Network with Distribution Alignment for Face Anti-spoofing TIFS 2021 Code
Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning ArXiv 2021
Unified Detection of Digital and Physical Face Attacks ArXiv 2021
Attention-Based Spatial-Temporal Multi-Scale Network for Face Anti-Spoofing T-BIOM 2021
Self-Domain Adaptation for Face Anti-Spoofing AAAI 2021 DA
Detection and Continual Learning of Novel Face Presentation Attacks ICCV 2021 Continual Learning; New attack types
Deep Learning for Face Anti-Spoofing: A Survey ArXiv 2021 Survey; Under review
Meta-teacher for Face Anti-Spoofing T-PAMI 2021 MetaTeacher
Dual-Cross Central Difference Network for Face Anti-Spoofing IJCAI 2021 Based on CDCN
Learning One Class Representations for Face Presentation Attack Detection Using Multi-Channel Convolutional Neural Networks T-IFS 2021 Multi-modality
Face Anti-Spoofing via Adversarial Cross-Modality Translation T-IFS 2021 Multi-modality
Cross Modal Focal Loss for RGBD Face Anti-Spoofing CVPR 2021 Multi-modality
Data Fusion based Two-stage Cascade Framework for Multi-Modality Face Anti-Spoofing T-DSC 2021 Multi-modality
Improved Detection of Face Presentation Attacks Using Image Decomposition ArXiv 2021 Albedo
Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection ArXiv 2021 CASIA-SURF 3DHiFi Dataset
TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection ArXiv 2021 rPPG
Structure Destruction and Content Combination for Face Anti-Spoofing IJCB 2021
Adaptive Normalized Representation Learning for Generalizable Face Anti-Spoofing ACM MM 2021

Year 2020

Title Venue Note
Revisiting Pixel-Wise Supervision for Face Anti-Spoofing T-BIOM 2020 -
Cross-domain face presentation attack detection via multi-domain disentangled representation learning CVPR 2020 DG, Disentangledment learning
Rethinking Shape From Shading for Spoofing Detection T-IP 2020 -
Camera Invariant Feature Learning for Generalized Face Anti-spoofing T-IFS 2020 Domain generalization
NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofing T-PAMI 2020 NAS; Domain generalization;
3DPC-Net: 3D Point Cloud Network for Face Anti-spoofing IJCB 2020 Pseudo Point Cloud
DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing T-IFS 2020 Reinforcement learning
Face spoofing detection based on local ternary label supervision in fully convolutional networks T-IFS 2020 Using a map of Ones is the same as a depth map!
Face Anti-Spoofing via Disentangled Representation Learning ECCV 2020 Disentanglement learning
On Disentangling Spoof Trace for Generic Face Anti-Spoofing ECCV 2020 Similar idea as the DeSpoofing method
CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations ECCV 2020 Contribute a dataset
Face Anti-Spoofing with Human Material Perception ECCV 2020 2D Attacks
Leveraging Shape, Reflectance and Albedo from Shading for Face Presentation Attack Detection T-IFS 2020 SfS for albedo, reflectance, and depth map
Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing CVPR 2020 RGB, Depth-contrastive loss, Code
Searching Central Difference Convolutional Networks for Face Anti-Spoofing CVPR 2020 RGB, NAS, CDCN, Code
Regularized Fine-grained Meta Face Anti-spoofing AAAI 2020 RGB, 2D Attack, Meta Learning, Code; Meta learning
Unsupervised Adversarial Domain Adaptation for Cross-Domain Face Presentation Attack Detection T-IFS 2020 Domain adaptation
Face Anti-Spoofing with Deep Neural Network Distillation IEEE Journal of Selected Topics in Signal Processing 2020 Domain knowledge distillation
Single-Side Domain Generalization for Face Anti-Spoofing CVPR 2020 RGB, Code
Domain Agnostic Feature Learning for Image and Video Based Face Anti-Spoofing CVPRW 2020 RGB, 2D Attack
Learning Generalized Spoof Cues for Face Anti-spoofing ArXiv 2020 RGB, 2D Attack, Code;
Learning Meta Model for Zero- and Few-shot Face Anti-spoofing AAAI 2020 RGB, 2D Presentation Attack, Meta Learning, Code; few-shot
Learning to Learn Face-PAD: a lifelong learning approach IJCB 2020 Life-long learning
Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing ACM TIST 2020 DA

Year 2019-2018

Title Venue Note
Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection T-IFS 2019 RGB, 2D Attack
Biometric Face Presentation Attack Detection with Multi-Channel Convolutional Neural Network T-IFS 2019 RGB+IR+Depth, 2D Presentation Attack
Face Anti-Spoofing: Model Matters, So Does Data CVPR 2019 RGB, 2D Attack,data augmentation
A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing CVPR 2019 RGB+IR+Depth, 2D Attack
Deep Tree Learning for Zero-shot Face Anti-Spoofing CVPR 2019 RGB, 2D Attack
Deep Anomaly Detection for Generalized Face Anti Spoofing CVPRW 2019 RGB, 2D Attack
Joint Discriminative Learning of Deep Dynamic Textures for 3D Mask Face Anti-Spoofing T-IFS 2019 VIS, 3D Attack
Multi-adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection CVPR 2019 RGB, 2D Attack,
Exploiting temporal and depth information for multi-frame face anti-spoofing ArXiv 2018 RGB, 2D Presentation Attack, Multi-frame
Face De-Spoofing: Anti-Spoofing via Noise Modeling ECCV 2018 RGB, 2D Attack, pseudo depth, Code
Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision CVPR 2018 RGB, 2D Attack, pseudo depth+rPPG
Learning generalized deep feature representation for face anti-spoofing T-IFS 2018 RGB, 2D Presentation Attack,
Unsupervised domain adaptation for face anti-spoofing T-IFS 2018 RGB, 2D Attack, unsupervised domain adaptation

Before 2018

Title Venue Note
Face Anti-Spoofing Using Patch and Depth-Based CNNs IJCB 2017 RGB, 2D Attack, pseudo depth
Face Spoofing Detection Using Colour Texture Analysis T-IFS 2016 RGB, 2D Attack, Color LBP
Spoofing Face Recognition With 3D Masks T-IFS 2014 3D Mask
Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes IEEE TIP 2015 RGB, 2D Attack,
Person-Specific Face Anti-Spoofing With Subject Domain Adaptation T-IFS 2015 RGB, 2D Attack, Person-specific
Face Spoof Detection with Image Distortion Analysis T-IFS 2015 RGB, 2D Attack, IDA
Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks T-IFS 2015 VIS, 2D Replay
Face spoofing detection from single images using texture and local shape analysis IJCB 2011 RGB, 2D Presentation Attack, LBP

System / Mobile Applications

Title Venue Note
Efficient Face Spoofing Detection With Flash T-BIOM Flash
RFace: Anti-Spoofing Facial Authentication Using COTS RFID INFOCOM 2021 RFID; privacy preserved
FaceRevelio: A Face Liveness Detection System for Smartphones with a Single Front Camera MobiCom 2020 RGB+Flashing
EchoPrint: Two-factor Authentication using Acoustics and Vision on Smartphones MobiCom 2018 Acoustic+Vision
Face Flashing: a Secure Liveness Detection Protocol based on Light Reflections NDSS 2018 RGB+Flashing
Light Field-Based Face Presentation Attack Detection: Reviewing, Benchmarking and One Step Further T-IFS 2018 Light Filed-Based
rtCaptcha: A Real-Time CAPTCHA Based Liveness Detection System NDSS 2018 RGB, Captcha
Face Liveness Detection Using a Flash Against 2D Spoofing Attack T-IFS 2017 RGB+Flashing, 2D Attack
Your face your heart: Secure mobile face authentication with photoplethysmograms INFORCOM 2017 RGB, rPPG
Seeing your face is not enough: An inertial sensor-based liveness detection for face authentication ACM CCS 2015 RGB+Accelerometer
Sensor-assisted facial recognition: an enhanced biometric authentication system for smartphones Mobisys 2014 RGB+ Sensors

Attack

Title Venue Note
Light Can Hack Your Face! Black-box Backdoor Attack on Face Recognition Systems ArXiv 2020 Face Recognition Attack
Virtual U: Defeating Face Liveness Detection by Building Virtual Models from Your Public Photos USENIX SS 2018 VR tech for spoofing

Notes

If you feel useful about this repo, please kindly cite and discuss my work in your publication.

@article{cai2020drlfas, title={DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing},
author={Cai, Rizhao and Li, Haoliang and Wang, Shiqi and Chen, Changsheng and Kot, Alex C},
journal={IEEE Transactions on Information Forensics and Security},
volume={16},
pages={937--951},
year={2020},
publisher={IEEE}, doi={10.1109/TIFS.2020.3026553}

@ARTICLE{cai2022MP, author={Cai, Rizhao and Li, Zhi and Wan, Renjie and Li, Haoliang and Hu, Yongjian and Kot, Alex C.}, journal={IEEE Transactions on Information Forensics and Security}, title={Learning Meta Pattern for Face Anti-Spoofing}, year={2022}, volume={}, number={}, pages={1-1}, doi={10.1109/TIFS.2022.3158551}} }