Unofficial diffuser support
KaustubhPatange opened this issue · 4 comments
Appreciated your work on transparent image generation. I've been working on an unofficial implementation of LayerDiffuse mostly forked from forge's extension to my repo: https://github.com/KaustubhPatange/Diffuser-layerdiffuse.
However I've noticed many flaky outputs where the transparent (intermediate) image sometimes does not get generated and has a weird output. I believe it solely depends on the model you use for example choosing Juggernaut XL over Realistic Vision XL tends to provide much cleaner outputs.
Hey thanks for your inplementation. I tried it out and it seemed to fail to produce transparent images somehow? Outputs something like this:
Yeah, this is more of a model issue. Trying with different seed would eventually give you a transparent tile image. But in VAE decoding it may or may not produce transparent images.
If you use forge you will face such similar problem.
Additionally what I would do is use the intermediate image and run rembg on it to remove those tile'ed transparent pattern.
Edit: Have added a basic rembg implementation in the repo.
It has huge VRAM requirements why is that?