/TryOnGAN

TryOnGAN: Unofficial Implementation

Primary LanguagePythonOtherNOASSERTION

TryOnGAN-pytorch

WIP : Unofficial pytorch implementation of TryOnGAN There are multiple branches :

  • UC : Unconditioned StyleGAN2-ada, without any changes.
  • PC-add : Pose conditioned with pose encoders outputs added to style block outputs.
  • PC-concat : Pose conditioned with pose encoder's outputs concatenated to style block outputs.

Useful Notebooks :

  • Alphapose notebook to create pose keypoints Open In Colab
  • Training Notebook for UC : Open In Colab
  • Training Notebook for PC : Open In Colab

Useful links (Drive) :

Some interesting results:

  • Interpolation
Color Length Region

I inverted two real images into latent codes and interpolated between the two codes. Interestingly the intermediate images are valid garments. Maybe we can extend this technique to generate novel garments composed of multiple components. Note that pose changes for UC models but not with PC. Scratch here means model was trained with random weights without transfer learning.

  • Style mixing for UC model

A is images generated by mixing latents of a real image with random latent code. B is by mixing two real images. Mixing here means replacing latent codes for lower six style blocks with other latent codes.

Datasets

Some of these datasets have images only of dress or have multiple people in the same image. Such images need to be discarded or modified.

StyleGAN2 code is based on official StyleGAN2-ada rep