WAN 2.2 - Text, Image and Video to Video (Patreon)
Downloads
Content
Video - https://youtu.be/MkAuWTLJp1s
Overview
WAN 2.2 is fun... but there are quite a lot of options! In summary they are:
5B - Image & Text to Video all-in-one
14B - Two sets of two models:
Text2Video - High & Low
Image2Video - High and Low
Wan 2.2 - 5B
The 5B model makes great quality video, but isn't as good at following the prompt as 14B. Speeds are fairly similar as 14B can be accelerated to just 6 steps, making each around 6 minutes on a 3090.
5B uses a lot less VRAM too, so for 8-16GB cards this may be your best option in the speed vs performance game.
5B is also a 720p model and lower resolutions can be a bit pants. I made the mistake of starting out at 480p and wondering why things looked bad :)
30 steps, dpm++_sde, cfg 3, shift 9 is typically decent but play around and see what you prefer. High cfg values tend to "burn" and lower shift values may not follow the prompt as well.
ComfyUI repackaged model - https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/blob/main/split_files/diffusion_models/wan2.2_ti2v_5B_fp16.safetensors
WAN 2.2 - 14B
The king of the jungle, but also a very hungry beast. FP8 quantisation helps on a 3090, and the same LoRAs as last week also give 2.2 a much needed speed boost by reducing the step requirement to 6.
Things that caught me out
Resolutions seemed a bit strange at first, in that 1280x720 gave errors but 1280x704 was OK. Not sure if that is how they're to work, but it works for now!
Workflows
Both 5B and 14B workflows are attached. The defaults should be good to go, but experiment away and do let me know what things you find!
They follow on from last week's WAN 2.1 video, so it may be worth starting there if you haven't already - https://www.patreon.com/posts/wan-t2v-i2v-and-135155677
Links to the various models you'll need are in the workflow, so you can just click to download.
Most files you can get from:
https://huggingface.co/Kijai/WanVideo_comfy/tree/main
https://huggingface.co/Kijai/WanVideo_comfy_fp8_scaled
As with the WAN 2.1 nodes, you'll also need the various custom nodes installed, as detailed in the workflow notes:
4 Custom Nodes - Install using ComfyUI Manager:
ComfyUI Wan Video Wrapper - https://github.com/kijai/ComfyUI-WanVideoWrapper
KJ Nodes - https://github.com/kijai/ComfyUI-KJNodes
Video Helper Suite - https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite
RGthree - https://github.com/rgthree/rgthree-comfy
Enjoy! :)