XLabs AI - ControlNets, IPAdapter & LoRAs (Patreon)

Video - https://youtu.be/g8W3xe5kRBQ

A whole different set of nodes for Flux.1 are available from XLabs to give a new sampler along with a whole bunch of different models for ControlNets, LoRAs and an initial ipadapter.

Canny & HED models allow you to control your generations using image outlines, whilst their depth model will work with depth maps. Use your own, or pre-process standard images as required.

It's still early days, but their IPAdapter option is another way to easily change the style of your images without needing to train a style LoRA. Simply provide a style image and prompt away as usual!

IPAdapter isn't just about styles though, as it also "sees" the content / composition too, giving all sorts of options when prompting.

Links

https://github.com/XLabs-AI/x-flux-comfyui

https://github.com/chrisgoringe/cg-use-everywhere

https://github.com/city96/ComfyUI_ExtraModels

Low end systems, can use https://github.com/city96/ComfyUI-GGUF with the sampler, but it doesn't look like controlnet or ipadapter works well with those models as yet.

Each of the attached workflows also has links for the various custom nodes in the notes, all of which I installed using ComfyUI Manager.