WAN 2.2 Animate! (Patreon)

Video - https://youtu.be/qUmfiSXE9ZU

Overview

Animating characters is now even easier thanks to WAN 2.2 Animate, and it works great with rodents (which is a big plus in my book!)

This model focuses on human pose and facial inputs to animate images of your choice :)

Another great feature of this model is it's ability to handle LONGER videos too. 5 second clips are great, but I've now tested HUNDREDS of frames in one go and WAN Animate seems to be able to handle it nicely, so no more "interesting" transition points once you go over the usual 81 frames!

Example videos you can grab from Pexels or Pixabay like I did, or you can make your own (if you have a webcam or similar).

When using a reference image, it's a good idea to match the first frame of your video, like in this example:

This isn't 100% required, but it does give you the best chance of success. Of course, one way to do this is with Qwen Image Edit like I did here!

The workflows come with a couple of options - replace person (keep video background) or image animation. Just toggle whichever options you want:

The usual performance & VRAM saving options are also available:

Increase the blocks_to_swap to reduce VRAM (and increase RAM use), or decrease the value if you have a high VRAM card (24+GB) to get a performance boost!

Attachment Information

For the most part everything works "out of the box", but for some video / image combinations I found the colours could go wrong, causing bloom or other unwanted effects.

If you also have issues like those, try the Context Options instead

This way is a little slower, and you'll see an example of it in the Context workflow. Setting the INT Constant to 77 or 81 is typically best. Also note the colour_match option too in the WANVideo Animate Embeds nodes.

Have fun! :)