Latent Couple / Two Shot not working in img2img or hires fix

[steamrick]

Hi,

unfortunately, latent couple only seems to be working with T2I. When using any type of I2I to increase output resolution, the colours of subjects contaminate each other and sort of average out. A pity.
I've tried to 'fight' it with the color control net, but that makes whole chunks of the image extremely blurry for some reason and didn't really work to preserve color, either.

If LC could be made to work with I2I, that would be a huge step forward.

Here's the non-upscaled version: blue-haired japanese, black-haired black and red-haired caucasian from left to right.

And here's what Hires fix and/or I2I makes of it: No more blue hair, no more dark skin and the redhead is beginning to tan.

The effect is less pronounced at lower denoising strength, sure, but at that point I'll also have far less detail than I want.