/Face-Modelling

Using VAEs to generate high quality face embeddings

Primary LanguagePython

Face Modelling

Using generative models to generate high quality face embeddings

Setup

  1. conda env update -f environment.yml
  2. conda activate faces
  3. pre-commit install
  4. poetry update && poetry install

Plan

  1. Use a very fast face detector which runs on cpu - MTCNN, Faceboxes, DeepFace has in-built alignment
  2. Align faces - Possibly DeepFace, or MediaPipe
  3. Embed faces - unsupervised pretraining
  4. Remove anomalies - Use DBScan for clustering, include some non-face clusters. Remove embeddings that are in non-face cluster.
  5. Index embeddings

Helpful Links