/openai-glide-text2im

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

GLIDE

This is sample repo reproducing the official codebase for running the small, filtered-data GLIDE model from GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models.

For more information, please see the original repo here: https://github.com/openai/glide-text2im/.

Figure-1 Figure-2 Figure-3

How to run

  • The text2im Open In Studio Lab notebook shows how to use GLIDE (filtered) with classifier-free guidance to produce images conditioned on text prompts.

  • The inpaint Open In Studio Lab notebook shows how to use GLIDE (filtered) to fill in a masked region of an image, conditioned on a text prompt.

  • The clip_guided Open In Studio Lab notebook shows how to use GLIDE (filtered) + a filtered noise-aware CLIP model to produce images conditioned on text prompts.

References

@misc{nichol2021glide,
      title={GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models}, 
      author={Alex Nichol and Prafulla Dhariwal and Aditya Ramesh and Pranav Shyam and Pamela Mishkin and Bob McGrew and Ilya Sutskever and Mark Chen},
      year={2021},
      eprint={2112.10741},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}