ControlNet Stack input increases KSampler Advanced Efficient image generation time proportionally to the number of active controlnets
alessandroperilli opened this issue · 4 comments
In the scenario below, I enabled a CR Multi-ControlNet Stack
node with 3 controlnets (Canny, Depth, and OpenPose). The stack conditions a KSampler Advanced Efficient
node.
![Screenshot 2023-10-30 at 11 18 17](https://private-user-images.githubusercontent.com/9775949/279039176-caaf613d-b00d-4ebd-8b25-055310815a8d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk3ODA4NjIsIm5iZiI6MTcxOTc4MDU2MiwicGF0aCI6Ii85Nzc1OTQ5LzI3OTAzOTE3Ni1jYWFmNjEzZC1iMDBkLTRlYmQtOGIyNS0wNTUzMTA4MTVhOGQucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDYzMCUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA2MzBUMjA0OTIyWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9NWEwYTRhNjlkNzIwNzNjYjRjY2E3ZjgwOTYzNGJmMjNmNWIxZGQ4MGQyMDJlM2U5ODZlODk1NzU0MDJjMTg4MCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.bgB6jCuH6tGVCpCKHkI02dH2RN_035NtjoLb9536134)
Doing so enormously increases the generation time: all things equal, the SDXL base model goes from ~3min30s / image (I'm on a Mac...) to ~8min50s / image.
If I modify the stack to only use 2 controlnets, the generation time goes down to ~6min36s / image.
With 1 controlnet only, the generation time goes down to ~4min51s / image.
Is this behavior normal? I don't recall ControlNet influencing generation time in A1111 or SD Next, even when I used 3 at a time, like in this case.
(I noticed this a while ago. It's not something new. I just didn't report it before because I wasn't certain it's an anomaly)
I would try and see how long it takes when you try to reproduce the workflow as closely as possible using auto1111 for reference. If I didn't have a diff issue w/efficiency nodes now, I would try to run your workflow on my hardware for comparison.
Thanks for the help. My workflow is here if you want to give it a go: https://perilli.com/ai/comfyui
Thanks for the help. My workflow is here if you want to give it a go: https://perilli.com/ai/comfyui
Is there a way to reach you? I have tried and there was no response. Trying to see if you could assist on a project. I have no issue sending a tribute or patron donation.
@KINGLIFER Sorry about that. Did you try to send me an email at the address on this page?
Click on Ask for a Quote
and you should be good to go. I checked the email address and it works as expected.