Home Creators Posts Import Register Favorites Logout

Downloads

Content

Hey everyone! I've just released a new video on "THE NEW MULTIMODAL AI KING!", called "QWEN IMAGE EDIT" made by the same team that created Qwen image. A multimodal model that is able to automatically edits images with incredible precision and that follows your prompt better than Kontext.

You can check out the video right here: https://youtu.be/6EVVV2lUMFU

I also created a 1-click installer for the Webui for my Patreon supporters for Local AND Runpod, that you can find right here: https://www.patreon.com/posts/137036485

Here the link to the manual install guide: https://pastebin.com/aYMsWDmr

Down below you will also find the QWEN_IMAGE_EDIT_WORKFLOW.json for free for you to use!

As always, supporting me on Patreon allows me to keep creating helpful resources like this for the community. Thank you for your support - now go have some fun😉!

Files

Comments

lichthorizont

i got this error : "TextEncodeQwenImageEdit mat1 and mat2 shapes cannot be multiplied (5336x1280 and 3840x1280)" could you help please?

ExusOne

Got the same error. Was tried to update comfyui and all nodes to newest version and it not help at all.

FILM426

Ive got the same issue. did you guys get a solution?

olly.enn

Try manually updating ComfyUI-GGUF in the Node Manager. Fixed it for me.

Aitrepreneur

Update comfyui using the update bat file inside the update folder and update all the nodes via the manager.

Aitrepreneur

Update comfyui using the update bat file inside the update folder and update all the nodes via the manager.

Pak26

Same problem here so I just change the clip loader (GGUF) to the Qwen2.5-VL-7B-Instruct-UD-Q5_K_S.gguf. All is working now !

Ron Harris-White II

Still having the same issues, and this is me doing a full update to ComfyUI.

Aitrepreneur

Because you need to update the gguf node as explained, make sure you also used the installer and that you have the mmproj model.in the text encoder

Eliot RRG

yes same problem for me, i updated comfy and the nodes # ComfyUI Error Report ## Error Details - **Node ID:** 93 - **Node Type:** TextEncodeQwenImageEdit - **Exception Type:** RuntimeError - **Exception Message:** mat1 and mat2 shapes cannot be multiplied (5320x1280 and 3840x1280) ## Stack Trace ``` File "C:\Users\evile\Documents\ComfyUIWebUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 496, in execute output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)

Stu

I have run the comfyupdate from the update folder but am still having issues, even with my other workflows now, I am looking into it, if I find a fix I will let you all know. Even using my other workflows I still get: Given normalized_shape=[3584], expected input with shape [*, 3584], but got input of size[1, 256, 4096] Even a bare bones just one image, fresh workflow it still is doing this. I am not sure why I was able to get it to work but I had to use the FP8 version of the Diffusion model and Clip. I cant get the GGUF ones to work they cause issues in all the work flows I have tried.

Brad

it's nice but the self censoring is off putting, you can get NSFW but not like with SDXL, and if i want disney, I will go to florida. (not your fault of course).

Ron Harris-White II

That was it. I did not have the mmproj model downloaded. Thanks!

Alexandre

Same issue here. Someone on Reddit posted: "I guess the problem is using gguf for clip encoder. If you use fp8 safetensors instead, it'll be fine. Until they update the gguf nodes to fix the issue." Where can I download fp8 safetensors??

JuanitoEmanuelo

getting errors wit this workflow "mat1 and mat2 shapes cannot be multiplied" everything's updated, used update_comfyui_and_python_dependencies.bat and still getting same error

JuanitoEmanuelo

ok the issue was that I didn't download Qwen2.5-VL-7B-Instruct-mmproj-BF16.gguf but after downloading it and placing it in the text_encoders folder now it runs fine but it's weird because I don't see any node loading that file.

Spigott_AI

Hi, how would this work for say changing clothing styles on 10 people? My wife and I worked on changing the clothing on her staff to 1600s clothes. Got there in the end with a hodgepodge of tools.

kaudlol

Unfortunately, still getting this "TextEncodeQwenImageEdit mat1 and mat2 shapes cannot be multiplied (5292x1280 and 3840x1280)" after all the above steps to resolve. Using ComfyUI via Pinokio, so had to install the mmproj files manually. I put them in both places where the Text Encoder files are, just to be sure I wasn't missing anything. FYI, the qwen image edit standard workflow works, but please let me know if I overlooked something. Hard to not be utilizing the add image portion from what Aitrepreneur added since it's like the make and break of this workflow.

kaudlol

SOLVED - If anyone runs into this issue, be sure to download a compatible "Qwen2.5-VL-7B-Instruct-mmproj-bf16.gguf" file. The model I was using was the "UD" instruct for the clip loader. Happy prompting y'all <3

Ameshin

If you're having the mat1 and mat2 shapes cannot be multiplied (5336x1280 and 3840x1280)" error don't forget the "UD" in the name. It mattered for me. EXAMPLE: If you're using Qwen2.5-VL-7B-Instruct-UD-Q4_K_S.gguf text encoder alter the name of Qwen2.5-VL-7B-Instruct-mmproj-BF16.gguf to: Qwen2.5-VL-7B-Instruct-UD-mmproj-BF16.gguf It required the "UD" !! took forever to figure that out ^^;

Alexandre

Sorry, my mistake. I didn't download the mmproj file as instructed. I just put it in the text_encoders folder and it worked. No more mat1 and mat2 error

Morpheus

my file is Qwen2.5-VL-7B-Instruct-UD-Q4_K_S.gguf text encoder, i couldnt get it to work by changing tis name, using the Q5_K_S text encoder is working for me with the Q4_K_S image edit model, tho it takes long (~35 secs per iteration) on the 4 steps flow

TomiTom1234

Whenever I try 2 pictures,and try to use the prompt (Make the 2 characters hug each other) I get this error : "mat1 and mat2 shapes cannot be multiplied (5408x1280 and 3840x1280)" I tried with (Switch latent) enabled, and disabled, same error everytime. I used 1024x1024 square resolution, then used 1024x576 wide, same result everytime. The pictures I used are also squares, one is 800x800 the other is 976x976 Any idea what is the problem here?

TomiTom1234

Never mind. As someone mentioned here, I downloaded Qwen2.5-VL-7B-Instruct-mmproj-BF16.gguf and placed it in text_encoder folder, and the error is gone. But why ??

Eliot RRG

its working now, i just remember i was in the nightly version, so i go to normal version and reinstall the nodes and work.

Matt H.

For the mat1/2 issue, I had luck updating the "comfy-gguf" node through the comfy-ui manager

RavenWT

Hey! It perfectly works for me on Runpod! Is there a way to download LoRas directly from Runpod interface? To avoid upload in the pod manually? It's very looooooong.... and slooooooow....

Killy_Blame

How to keep the Characters consistent. I get everytime a different set of people.

theworldofanatnom

sooooo for anyone having the "shape '[1, 16, 51, 2, 80, 2]' is invalid for input of size 4177920" to error, if you look over to the right of the model loader. make sure the qwen vae is selected. even if you see it open it again and select the qwen_image_vae.

Aitrepreneur

use Port 2999 to upload the lora, then once it's done go back to the port 8888, and your lora file will be in the workspace folder, you can then cut it then paste it inside the comfyui/models/loras folder, then go back to comfyui press "r" to refresh the lora list and then select the lora

Timmy

The link in this post appears to be a repo that requires the FlyMyAI API, which you have to pay for. It looks to be an advertisement.

RavenWT

Very clear as usual! Thank you!

Aitrepreneur

Yes, I already trained a lora for it myself, I'll make a video about it soon

Mark Burns

RunPod CUDA Error: CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. I ran an RTX Pro 6000 on RunPod (221 GB of Memory)

Mark Burns

also, quick side note, in your instructions for RunPod it says "click here for the comfyui template (aitrepreneur/comfyui)", but there is no link I can find for clicking. I believe it just needs a quick update to the template.

Aitrepreneur

blackwell gpu are not supported out of the box with the template but you can make it work by using these commands: go inside the ComfyUI folder, click on the terminal icon then type: source venv/bin/activate pip uninstall torch pip install --upgrade torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128 Then go to port 8000, click stop to stop the comfyui app, then click on the start button. Wait a few minutes for the app to relaunch then you can go inside the port 3000 back again

Bob

error: TextEncodeQwenImageEdit mat1 and mat2 shapes cannot be multiplied (5292x1280 and 3840x1280)

Bob

we need reference image set for text to image, otherwise its just random stuff all the time

W4v3r1d3r

I also have the same error. I solved by using normal Load CLIP node using the qwen_2.5_vl_7b_fp8_scaled.safetensor also don't forget to change the type to qwen _image

ak pak

This ACTUALLY WORKS!!! 3080, 10 GB VRAM

Raptorgatorslayerdragon69

Hello I’m having trouble understanding which membership to choose that has the 1 click install to run image to video locally and which it is. Can you point me in the right direction

mario ledesma

I can't find that node in ConfigUI, it won't let me put what you mentioned. Could you help me? Thanks.

Jordan Freeman

How do I change the seed to be random?

Greono Games

It's not NSFW, when you remove the clothes, an intimate "clothing" is added.