Avatars for Skype and Zoom. Democratized.
Disclaimer: This project is unrelated to Samsung AI Center.
- Linux (with 1080 Ti GPU): 33 fps
- Mac OSX (MacBook Pro 2018; no GPU): ~1 fps
- Download model's weights from Google Drive [716 MB]
- Place
vox-adv-cpk.pth.tar
file in the root directory
It is supposed that there is only one web cam connected to the computer and it's in /dev/video0
. Installation process will create a virtual camera /dev/video9
, so this device must be reserved. You can change settings in scripts/settings.sh
.
source scripts/install.sh
For Mac it's quite difficult to create a virtual camera, so we'll use CamTwist app:
- Download and install CamTwist from here. It's easy.
- Setup
avatarify
conda environment with all required dependencies:
source scripts/install_mac.sh
Copy your avatars into avatars
folder. Crop pictures to make them square. Prefer pictures with uniform background.
Your web cam must be plugged-in. You can choose your camera by changing CAMID
in scripts/settings.sh
script.
Run:
bash run.sh
- Run:
bash run_mac.sh
- Go to CamTwist.
- Choose
Desktop+
and pressSelect
. - In the
Settings
section chooseConfine to Application Window
and selectpython (avatarify)
from the drop-down menu.
Your face should fit in the red rectagle: it should not fit perfectly, but don't get too close/far. After that, press any number from 0 to 9 on your keyboard and one of the avatars from avatars
directory will appear.
Run Skype or Zoom only when Avatarify is running.
Go to Settings -> Audio & Video, choose avatarify
or CamTwist
camera.
Go to Settings -> Video and choose avatarify
or CamTwist
from Camera drop-down menu.
Make a call, allow browser using cameras, click on Settings icon, choose avatarify
in Video settings drop-down menu.
Our goal is to democratize deepfake avatars. To make the technology even more accessible, we have to tackle two major problems:
- Add support for more platforms (Linux and Mac are already supported).
- Optimize neural network run-time. Running network real-time on CPU is of high priority.
Please make pull requests if you have any improvements or bug-fixes.
- Zoom/Skype doesn't see
avatarify
camera. Restart Zoom/Skype and try again. - Avatar image is frozen: In Zoom, try Stop and Start Video.
bash run_mac.sh
crashes with "Cannot open camera": Try to change CAMID inrun_mac.sh
from0
to1
or2
- Avatrify uses First Order Motion Model for generating avatars.