/sam-controlnet

Primary LanguageJupyter Notebook

Conditioning Stable Diffusion with Segment Anything

Please view our blog post for details about our project

Notebooks contains the 3 main notebook used during our project.

The notebook should be run in that order

  1. Sam-Controlnet-Dataset
  2. Sam-Controlnet-Train
  3. Sam-Controlnet-Eval

This create a custom controlnet trained on the segment anything model It is then possible to use that controlnet model to condition stable diffusion with segmentation masks