Control your Qwen Image generations with Union Control! (Patreon)

Video - https://youtu.be/EU-rV_bhA3M

Overview

Qwen Union ControlNet is here, so now we get even control over our Qwen image generations! It has all the typical stuff we've come to expect from a ControlNet such as canny, depth and pose... plus it even works with the Qwen-Image-Edit model reasonably well too!

There are a couple of options for the Union Control, but the ComfyUI example uses the LoRA so I figured I'd start there. The initial tests seemed to work well, and whilst text-to-image with control is great, I wanted to push things a bit further and see what would happen.

As the Comfy example used the standard Qwen-Image model, I though why not see how it does with the Qwen-Image-Edit one too, and throw a couple more images in there too... and it turns out it does do something after all!

After testing for a bit both with and without the Union LoRA enabled, the difference was certainly noticeable. The OpenPose control was a bit tricky, meaning it was time to see which options could help.

At first I tried the conditioning strength, but no difference there. Next up was the LoRA strength and LatentMultiply, it should be able to increase and reduce the strength of the latent after all, right?

Well, it turned out both yes and no. Yes it did have an impact, no it wasn't quite what I was expected. After testing for a while, the HIGHER latent multiply values actually seemed to LESSEN the impact of the Control image, and increase the impact from the control net. Nice. Mission accomplished, only not quite as expected :)

So now we have a way to use Union + multiple images + Qwen-Image-Edit which gives sort of "Flux Redux" like reimagined results! Different seeds also had a bit impact too, with some seeds leaning more heavily into the prompt and other more into the input images.

Also worth noting that there are now Qwen-Image-Edit Lightning LoRAs too now - however they didn't seem to work quite as well for the "Reimagine" style generations to me, but give those a go too and see what you think!

Workflows

A couple of workflows this time!

The first one is the standard Qwen-Image + Control Union + lighting + HiRes fix. Nice and easy to use, does what it says on the tin!

The second one is Qwen-Image-Edit + Control Union + lighting + HiRes fix + LatentMultiply. This one relies quite heavily on prompting, but you also get some control over how much you want the controlnet or inputimages to influence the output from your prompt. Lots of fun :)