FaceNet Pytorch Trainer with Mask Augmentation

Train FaceNet (InceptionResNet v1) on faces wearing a mask augmentation with combination loss (Triplets and Cross-Entropy).

This train FaceNet by transfer learning the pre-trained to adap with masked faces for use as features extraction in face recognition model or application.

Prerequisites

python
pytorch
dlib
opencv
sklearn
pandas

Pre-Trained Models

MTCNN face detection model (optional) or use HOG method.

rnet, pnet, onet

Face shape 68 predictor

shape_predictor_68_face_landmarks

FaceNet pre-trained on CASIA-webface

20180408-102900

Dataset

For training use CASIA-webface or any face dataset to train.

Since the homepage has gone I can't provide a link, But there a lot other link on the internet.

For evaluation use LFW and LFW_pairs.txt as test data.

lfw-deepfunneling

Create masked face dataset on both train and test data.

./create_masked_face_dataset.py

**Edit the path in code.

How to wear a mask

Use face detection and face shape to get face landmark select the triangle pieces coordinate to warp the correlate pieces on the mask image to put into the face image.

As for the triangular piece selection process, it is a manual process. If you want to edit or add new mask image you need to select the face landmark point index and (x, y) position on mask image then add to FaceMasking.py code.

Evaluation

Histogram distribution of distance prediction of masked LFW face pairs data. (blue is the distance of the same person's face pair, red is the distance of the different person's face pair).