/toy-diffusion

A toy implementation of a diffusion model for low-dimensional data

Primary LanguageJupyter NotebookMIT LicenseMIT

Toy diffusion

Open In Colab

This is an implementation of a toy diffusion process, able the generate samples from a learned 2-dimensional distribution. It is an alternative implementation of the experiment presented in Sohl-Dickstein et al paper on using diffusion models and deep networks to generate new samples for a given dataset.

A simple pytorch network learns to predict the noise component in a data sample. This is then used in a DDPM sampler to generate new samples from the distribution.

Here is an example of generation of samples for a 2D swiss roll distribution:

alt text

References