/stylegan3-vj

StyleGAN3 Video Jockey

Primary LanguagePython

StyleGAN3-VJ

StyleGAN3-VJ create audio reactive visuals for VJ using StyleGAN3.

Example

https://youtu.be/oVP4AxhGXDo

Reference

https://github.com/hanhung/Creating-Audio-Reactive-Visuals-With-StyleGAN

Usage

StyleGAN3-VJ can be run in Docker.

docker build . -t stylegan3vj:1.0 -f Dockerfile

docker run --runtime=nvidia -it \
 --rm -v `pwd`:/workspace \
 --name stylegan3vj stylegan3vj:1.0 /bin/bash
python feature_extraction.py --bpm $bpm_of_music --path $path_to_mp3

wget https://api.ngc.nvidia.com/v2/models/nvidia/research/stylegan3/versions/1/files/stylegan3-r-afhqv2-512x512.pkl

python gen_images.py --model_path $path_to_pretrained_model

python gen_images.py --model_path stylegan3-r-afhqv2-512x512.pkl

python create_video.py --music $path_to_mp3