lllyasviel/sd-forge-layerdiffuse

how do i run it by diffusers

Opened this issue · 4 comments

give some examples,please

Sharing this thread.

The base layer diffusion model is a SDXL LoRA trained on the modified latent space. I managed to convert the given checkpoint to LoRA and use it with diffusers by calling pipe.load_lora_weights().

But how do you use the other four layer modules:

  • layer_xl_bg2ble.safetensors
  • layer_xl_bgble2fg.safetensors
  • layer_xl_fg2ble.safetensors
  • layer_xl_fgble2bg.safetensors

Its tightly integrated with sd-forge and using things like extra_concat_cond and I have no idea how to integrate them to diffusers.

i am waiting for the official integration plan

@xiankgx can you share how you used the base model for inference in diffusers?

Also curious how this could work with diffusers