rinongal/StyleGAN-nada

Control eye position

ganganstyle opened this issue · 2 comments

ganganstyle commented

Hello, thank you for this great work!
Is there a way to control the position of the pupils inside the eyes / gaze?
Maybe someone has been able to train and can share a latent that does this?

rinongal commented

Hi,

StyleSpace Analysis have an eye gaze direction which you may be able to use. It uses the S-space and not the W-space, and I believe their code is based on the Tensorflow StyleGAN implementation, which means you'll have to do some (probably minor) code-work yourself.

I did add s-space support to the model here which might save you some work, but it's not terribly well documented since nothing in our work actually uses it.

ganganstyle commented

That looks very promising, thanks!
Not sure if I'll be able to actually implement it though..

As a side note - having the editing capabilities from StyleSpace in the StyleGAN-nada Huggingface Demo would be epic! Super useful for animation purposes as well.