Regional LoRAs in ComfyUI (Patreon)

Video - https://youtu.be/dASMuSCCNSU

Ever wanted to use one LoRA for part of your image, and another totally different LoRA (or model) for another?

Well, if you've seen the recent ComfyUI blog post about some new nodes for adding LoRAs to conditioning areas, along with various other nodes too, then you'll know this is now a lot easier to do!

The blog quite is quite long and goes into some depth, so instead I figured I'd start off a lot more basic and kinda work up from there ;)

Example workflow combining Redux & using a style LoRA on just one part:

Example output (workflow 8):

Links

https://blog.comfy.org/masking-and-scheduling-lora-and-model-weights/

https://github.com/comfyanonymous/ComfyUI

https://github.com/logtd/ComfyUI-Fluxtapoz

Workflows

Loads of workflows this time! They are therefore numbered this time, starting off with the most basic and working up to the more involved ones.

Workflow 1 is a very basic version of regional prompting using the new nodes, with workflow 8 mixing both Fluxtapoz regional conditioning via the model, along with a second set of regional conditioning using a LoRA, like the example above.

Do note that the more conditioning you have, the more it's going to have to compute - like when you add a second conditioning to Flux in the form of a negative prompt.

Adding a LoRA to an area also then increases the time required, though this can be reduced slightly through use of timesteps.