/picturate-mwml

An End-to-End Generative Text-to-Image Synthesis Engine

Primary LanguagePythonMIT LicenseMIT

picturate

Based on https://github.com/suetAndTie/cycle-image-gan

Paper https://arxiv.org/abs/2003.12137

A MadeWithML 2020 Summer Incubator Camp Project

  • BERT encoder
  • Cycle-GAN
  • Image2Text encoder

Try it on Colab!

Open In Colab

Download Data

  1. Download AttnGAN preprocessed data and captions birds
  2. Download the birds image data. Extract them to data/birds/

Instructions

  • pretrain STREAM
python pretrain_STREAM.py --cfg cfg/STREAM/bird.yaml --gpu 0
  • train CycleGAN
python main.py --cfg cfg/bird_cycle.yaml --gpu 0