WarpFusion early access v0.5.0 new features: match color, auto brighness (Patreon)

Hello there!
Here's a new version of you-know-what :D

It's featuring some new stuff and minor QoL\bugfix-ish improvements, thanks to your feedback, as usual. 

Match Color

When using inpainting for inconsistent areas, strong flickering was introduced as well. To counter that, I've added an algorithm for matching colors of what we're using to replace inconsistent areas to the warped stylized frame, whether we're replacing those areas with raw init video or inpainting them.

Color matching is applied to raw\inpainted footage before mixing with stylized previous frame via consistency mask.

Automatic Brightness Adjustment

As a side effect, matching color to previous frame tends to darken the image (or overbrighten in some cases), I've also added automatic brightness adjustment from the awesome progrockdiffsuion repo. The main difference is that mine also has fixed value addition\subtraction, which allows to prevent oversaturation. It also always corrects border values, so that there won't be burnt out or pitch black pixels.

The settings work the following way: 

enable_adjust_brightness: on\offs the whole thing

high_brightness_threshold: if image MEAN value is above this value, brightness will be decreased: 

- whole image multiplied by high_brightness_adjust_ratio
- high_brightness_adjust_fix_amount be subtracted only from pixels above the threshold

max_brightness_threshold: high_brightness_adjust_fix_amount will be subtracted from all pixels above this value even if high_brightness_threshold is not crossed

low_brightness_threshold: same as with max_brightness_threshold.
if image MEAN value is below this value, brightness will be increased:
- whole image multiplied by low_brightness_adjust_ratio
- low_brightness_adjust_fix_amount be added only to pixels below the threshold

min_brightness_threshold: low_brightness_adjust_fix_amount will be subtracted from all pixels above this value even if low_brightness_threshold is not crossed

As you can see in the video, color matching reduces flickering, and brightness adjustments helps correct that inevitable darkness :D

Early Stopping

By popular demand, early stopping has also been added (it's right below the main steps parameter)

It works like this: with 50 steps and 5 stop early, it will stop diffusion at 45 steps and move to the next frame. Just make sure it's less than frame_skips_steps or it will just skip everything :D 

If frame skips steps is at 70%, it means it'll be starting diffusion at 35 steps and run till 45 with early stopping, but if you set early stopping too high (or is it too low tho? :D), to something like 15, it will just skip all frames because it starts with 70% skip  at 35 steps and ends at 35 steps with 15 stop early

Other fixes

Bumped frame counter from 4 leading zeros format to 6. This means videos with over 9999 frames no longer cause sorting errors. (i.e. frame 10000 goes after 1000 if you don't add a leading zero to it, and 010000 goes after 009999 just fine)

Moved LAMA and RAFT models in together with all other models (so that you can keep 'em on your gdrive or elsewhere)

You can grab the new version here - https://www.patreon.com/posts/warpfusion-early-70054888

Once again, thank you for your support and see you next time! Love, Alex :D