New Video Upscaling Pipeline:

In the next beta update, the all new video upscaling pipeline will be available.

Similar to the new frame interpolation pipeline in the last update, this upscaling one is also significantly faster and uses no cache images.

The first upscaling engine to adopt this will be Real-ESRGAN, which should adapt to a wider range of situations.

Comparison:

24:08 long Anime Video, 2x upscale, 2x interpolation, RTX 5060 laptop balanced power profile, ESRGAN, Anime Video Mini model, Rife 4.6

ALL NEW video processing pipeline: 10:41

OLD video processing pipeline: 20:44

1.94x Faster

(More comparison data coming soon, need to sleep)

Recent Roadmap:

I've been working on a lot of prototypes & feasibility validation in the background recently, and for the first time, this project actually seems to have a roadmap?

I've been updating this project consistently for years, but I've just been doing whatever comes to mind randomly, so this is kinda new for me.

Anyway, here is a short list of what you can expect to come next:

Expanding the new video upscaling pipeline to all engines

An even more streamlined & faster video processing pipeline

New upscaling models for both Photo and Anime

New Upscaling Engines! With the familiar Vulkan backend and the same compatibility across all hardware platforms, built exclusively for this project! Still deciding to keep using Vulkan because I don't want to drop support for non-Nvidia cards in the middle of this chip shortage.

Engine side rewrite & optimization to push performance even further, including both the upscaling and frame interpolation engines

More advanced rename features for output files

More languages

I still have another long list of things I want to work on in the future, but these are the ones I'm more certain about for the near future. If the feature you want isn't in this roadmap, it doesn't mean I won't work on it at all.

Also, please note that the order of the items in this list doesn't represent the order they'll be released in.