Time To Move - Control Video for WAN 2.2! (Patreon)

Video - https://youtu.be/RwXQlzef1nw

Overview

Project Page - https://time-to-move.github.io/

Time To Move gives us a new way to control video generations using WAN 2.2! The project page linked above gives loads of ideas, so now you too can create a badly animated cutout video in your favourite video editor, then get Time To Move to make it better for you!

Object motion control, camera motion control, appearance control are now yours thanks to this project :)

For example, you can now cut out a section of an image and just move it across in ShotCut, DaVinci Resolve etc, and it doesn't matter that it leaves a big hole:

Time To Move will sort out any holes or warping, but note that it's best to black cutout holes, as they won't inpaint quite as well as warping or other coloured noise.

Their GitHub repo also provides a application for cutouts, although it is somewhat basic.

Workflow

NOTE: With the new "2.0" node display, the workflow will still function... but things will look a bit weird, plus it seems the "get" and "set" nodes don't let you use the nice pulldown menu. For the time being it is suggested that do not use the "Modern Nodes 2.0 Design" mode.

If you have enabled it, then this can always be changed in settings:

As with any design change, I'm sure this will impact the look and feel of a whole bunch of custom nodes for a while while everyone updates to the new design standards.

If you've already got WAN 2.2, then there are no new files to download, but links are provided in the workflow as usual:

VRAM usage depends on your Block Swap settings, so if you're getting "out of memory" issues, then try changing the settings:

You will, of course, need some badly animated control video to make better, and you can download their example assets from https://github.com/time-to-move/TTM/tree/main/examples/cutdrag_wan_Monkey

The generated video resolution is set by the first resize node:

Standard WAN 2.2 resolutions apply, so you can go up to 720p.

Also included is the standard WAN 2.2 Image to Video option, allowing you to compare outputs. This can help a little with getting prompting better! As usual, the options control panel is available for easy selection of the available options.

Have fun! :)