/StableDiffusion

Implementation of StableDiffusion from scratch using PyTorch

Primary LanguagePython

StableDiffusion

An implementation of Stable Diffusion from scratch.

NumPy Python PyTorch

Installation

Install the requirements using the following command:

pip install -r requirements.txt

Download weights and tokenizer files:

  1. Download vocab.json and merges.txt from https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main/tokenizer and save them in the data folder
  2. Download v1-5-pruned-emaonly.ckpt from https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main and save it in the data folder

Tested fine-tuned models:

Just download the ckpt file from any fine-tuned SD (up to v1.5).

  1. InkPunk Diffusion: https://huggingface.co/Envvi/Inkpunk-Diffusion/tree/main
  2. Illustration Diffusion (Hollie Mengert): https://huggingface.co/ogkalu/Illustration-Diffusion/tree/main

Acknowledgement

This implementation is a rewrite of this implementation.

The purpose of this project is to apply and expand my knowledge about stable diffusion.