Flux is awesome! :) (Patreon)

AuraFlow 0.2, AuraSR v2 and Flux? So many new things!

Flux is most certainly worth a try, but both models will benefit from fairly beefy systems with at least 24GB VRAM and 32GB RAM, so beware to go slow if you don't meet the specs.

4 steps, amazing quality... what will we see in a few months time, I wonder?

Links:

https://huggingface.co/fal/AuraFlow-v0.2https://blog.fal.ai/aurasr-v2/

https://github.com/black-forest-labs/flux

https://huggingface.co/black-forest-labs/FLUX.1-schnell

https://comfyanonymous.github.io/ComfyUI_examples/flux/

https://huggingface.co/comfyanonymous/flux_text_encoders/tree/main

https://blog.fal.ai/flux-the-largest-open-sourced-text2img-model-now-available-on-fal/

Flux

1. Download t5xxl_fp16.safetensors & clip_l.safetensors into your ComfyUI/models/clip/ directory you can find them on: this link.

You can use t5xxl_fp8_e4m3fn.safetensors instead for lower memory usage but the fp16 one is recommended if you have more than 32GB ram.

2. Download the vae from here into your ComfyUI/models/vae/ directory.

3. The Flux Schnell diffusion model weights from here  into your ComfyUI/models/unet/ directory.

Update

Also added an inpainting example :)

Update

Added a high-res fix example

Update

Flux_Dev_LLM_v0.json

Longer prompts can be better. Thing is, I can't be bothered. So I added an LLM to do it for me -

The prompt here was simply "Just make a cool picture with the text "PICTURE" somewhere in it, idk", which resulted in the longer version - "In this visually striking image, the bold letters "PICTURE" sprawl across a worn, velvety red canvas like a vintage cinema sign. Emblazoned across two-thirds of the rectangular canvas, the capitalized letters appear in a distressed cream font, their peeling edges evoking feelings of nostalgia. Against a desolate urban landscape where skyscrapers loom in hues of midnight blue and embers orange behind the letter 'P' and 'C', an isolated, dilapidated silver cinema projector casts long, slivering shadows in monochromatic grayscale across dusty cobblestone streets below."

I mean, who can be bothered to type all that, am i right?

For the LLM / node combo I've started with llama3.1 using these two options for local running:

It's an LLM party! - https://github.com/heshengtao/comfyui_LLM_party

Tested locally with ollama - https://github.com/ollama/ollama - using llama3.1

LLM party has loads of options (it really is an LLM party!), so plenty of choice.

Think I'll try Mistral next...