ExponentialML/ComfyUI_VisualStylePrompting

Not Work!

jesenzhang opened this issue · 16 comments

I tried the workflow, not worked!
workflow (2)

same here :((

It can work though:

ComfyUIVisualStylePrompting

It can work though:

ComfyUIVisualStylePrompting

It seems like not working with '--force-fp16' or sdxl . and I added controlnet , It did a little effect ,no more. How can I get the correct result?
workflow (3)

但它可以工作:
ComfyUI视觉风格提示

似乎无法使用 '--force-fp16' 或 sdxl 。然后我加了controlnet,起到了一点作用,仅此而已。我怎样才能得到正确的结果? 工作流程 (3)

“true” off

I just can't get satisfactory results.
workflow (4)

Hey. I can confirm that there's something that's preventing the condition from inferring properly.
I'm busy with some other projects, but I will look to address this soon.

Yeah the example doesn't seem to work.

no work too

微信截图_20240321092714
经过大量测试,在目前插件版本下,将“apply visual style prompting"的denoise,和采样器的cfg值降低,会有一定效果,期待作者的下一个版本。

Hey everyone here. I've released an update that fixes some bugs, as well as adds an option to select which blocks to utilize (thanks @ziyaxuanyi!), so please pull the latest request.

The block selection at the moment is "lazy" in the sense that only the block group is chosen, and not the specific layers recommended in the paper. Using only the output blocks seems to work very well in my tests.

This has only been tested on 1.5 based models, but should work with SDXL as well.

Let me know if anything has improved or if anything is working for you!

image

This is working but in a pretty chaotic way with the default CFG (7.0/8.0): 2/3 of the time I'm getting not related generation. By taking an higher CFG like 10 I'm now following the prompt more often

Screenshot 2024-03-22 at 00 04 29 Screenshot 2024-03-22 at 00 04 49 Screenshot 2024-03-22 at 00 05 17 Screenshot 2024-03-22 at 00 05 28

@ExponentialML, this is very unstable. I have a lot of bleeding between reference content and generation. I'm giving you examples here so we can debug this together: I don't want the rabbit 😂

workflow (1)
workflow (2)

Workflow is in the screenshot payload if you want to reproduce

There is in ComfyUI that's not updating the state of my node (you have to reload the model on each prompt / settings change), but other than that it seems to be working as intended.

image

EDIT: To get around the Comfy bug, simply update both the reference and conditioning prompts. I'll try to find a workaround for this.

I applied a major update. Please read the main README and use the updated workflow.

test on sdxl ,It seems that there is still room for improvement.
visualstyleprompt

The new version did work at first try for my example!!!

Huge kudo to you @ExponentialML, I really like your job here <3.

Screenshot with payload here:
workflow (3)

workflow (4)