Home Creators Posts Import Register Favorites Logout

Downloads

Content

Ultimate Video Upscaler preview before release: the app adds deterministic upscalers such as 4x-UltraSharp and RealESRGAN with batch frame upscaling.

Note: this is an older post kept for reference. The current, maintained version is SECourses Upscaler Pro: SeedVR2 & FlashVSR+ Video and Image Upscaler.

Announced as almost ready, better than Topaz AI at an industry level and capable of automatically upscaling entire movies; readers were asked to check all images and leave feedback on features. Planned next: cancel, full preset save and load, and VRAM presets for 8 to 80 GB GPUs. The released app is SECourses Upscaler Pro.

  • Please very carefully check every screenshot and let me know what you think : screenshots_as_zip.zip

  • What more we can add

  • What we lack

  • The app is hopefully almost ready

  • I have added deterministic upscalers as well and they are dynamic so you can use your own downloaded models as well

  • Currently we have the followings pre downloaded

    • • 2x-AnimeSharpV4_Fast_RCAN_PU.safetensors
      • 2x_AniScale2_Omni_i16_40K.pth
      • 4x-AnimeSharp.safetensors
      • 4x-UltraSharp.safetensors
      • 4xNomos2_hq_dat2.safetensors
      • 4xRealWebPhoto_v4_dat2.safetensors
      • HAT-L_SRx4_ImageNet-pretrain.safetensors
      • Kim2091-4x-UltraSharp.safetensors
      • RealESRGAN_x4plus.safetensors
      • RealESRGAN_x4plus_anime_6B.safetensors

    • The advantage of deterministic upscalers is that we support batch size upscale (multiple frames upscaled at once and makes it way faster) + they are already ultra fast since they are not diffusion based

What I have in my mind as next:

  • What I have left in my mind are Cancel feature that will immediately cancel every generation and return back as a video currently running generation

  • Full preset save and load feature

  • Making different VRAM presets for target 1024x1024px resolution like 8 GB GPUs, 12 GB GPUs, 24 GB GPUs, 80 GB GPUs etc

Before app is published bronze subscription level price will be raised to 6.99$ from 6.00$

Existing subscribers won't be affected (you continue same price as long as you never cancel) only for new subscribers so you can subscribe now if you didn't yet

New feature added to hopefully upcoming ultimate SECourses video upscaler app after was requested. If you have feature ideas please let me know

Related posts

All posts in this topic: Image and Video Upscaling and Restoration · New to SECourses? Start Here: Best and Most Popular SECourses Posts

Files

Comments

koon grizzly

that's a lot of upscalers, can't wait to test :-) I don't know if it is something that can be done, but using teachache creates bad or blurry hands for people, could an upscaler do something about that ? (like there are upscalers that try to make faces look better or for photo we have ai enhancers that create new details in photo)

The90sPope

The thing is, in the end of the day, you want a diffusion based upscaler for the final output. I've been using Starlight Mini on my PC, it runs locally, it's slow but result is superior. It smoothens out the frames, makes them more cohesive and corrects inconsistencies. When you apply the same technique for each frame, it will be inconsistent, because longer AI videos are made out of many separate clips, which require different handling. That's why diffusion model shines on AI videos. If you have non AI videos, then this upscaler is faster and more reasonable to use. But on AI videos, diffusion is the way to go. I stopped using other Topaz models and only use their Starlight mini. Result is like night and day.

SECourses

We have Starlight max version not mini on this app :) get a beefy GPU, auto split into scenes and upscale 96 frames at once

SECourses

nope upscaler probably wont fix it. upscaler aim is being loyal to the original video but adding more details

decoRyder

I own Topaz Video AI, and I tested Starlight Mini extensively. All in all it's a disappointment, it would distort facial features, and notably - hands, and it was dirt slow. I got better results just using the Prometheus Upscaler.

Philip Heggie

I have RTX 3090 24GB what is the maximum upscale resolution?

Arek Wawrzyniak

Based on example I see that banding of colors on eyes and cheeks is stronger on upscaled. I think frames should be "restored" or smoother before upscaling. The best would be to see example with generated realistic video with people etc. Because there is a lack of good upscaling video with realistic scenes. Some day I tried your SUPIR upscaler for frames of videos, all was ok but small details like hair was generated with randomly seed so they didn't move but blinked.

SECourses

this example made with weak deterministic upscale not with STAR.

SECourses

Well there is a huge trade off between max resolution and number of frames window. so if you go with lower number of frames, thus worse quality and consistency, you can go higher res. this model is vram monster but also quality monster

SECourses

this will be way better hopefully

SECourses

I hope you like our upscaler once published. please give me feedback once published

Philip Heggie

can Star upscale 720p to 720p that's what i do with Topaz Starlight Mini

JS

Can you add a very basic editing tool to cut sections of video and export them either directly to the upscale section or as a saved file?

DanO..

Also... the example is an animated .gif which will band all on it's own.

Mike Mitsik

I would like to see examples in a more dynamic video

SECourses

yes will do hopefully. still trying to finish all features.

SECourses

gradio video supposed to have this but let me search this

SECourses

720p to 720p is same resolution how do you upscale?

The90sPope

Starlight is for finishing things mostly, you have to preprocess with noise if you want good results, It's by far the best upscaler available locally, STAR might match it in some synthetic benchmarks but in reality it will make more artifacts. Anyways, I am looking forward to try it. It's always nice to have as many tools on your hands as possible. STAR might shine in some other aspects.

Philip Heggie

well topaz starlight cleans it up and adds details. You say your upscaler uses a lot of gpu resources increasing resolution so STAR should be able to add details without upscaling and do it faster with no upscaling

SECourses

yes this one has 1x upscale option as well

SECourses

yes i hope STAR be better than all

Milan Šaffek

Hi Furkan. app looks very promising!. Do you plan to include face restoration feature ? (codeformer / gfp gan)

SECourses

wow nice recommendation. i am gonna add CodeFormer . it is best right?

Milan Šaffek

Both have great results, one of two has better quality, but unfortunately don't remember which one it was.. maybe its worth to try both :)

SECourses

I will add CodeFormer first then we may add other one later

Clinton

This is probably a rediculous request, but it's for an old video I edited that I have been trying to restore. It was transferred a few times over the years and is very dicey now, with wobbly video and edits that can pull the video ever so slightly out of sync for a moment. Can the program help with this by detecting a shot (starting with the first frame in a shot, going through the end frame of that shot) and only do the one shot? I know I would then have to move the playhead and do hundreds of individual shots to clean up the video, but at least by automatically detecting a shot it wouldn't be necessary to also move the in and out put again and again, too. Probaby too niche a feature for most people to need, through.

SECourses

well i didn't understand you request can you elaborate more?

Clinton

Sure. I will try. I am trying to clean up a video that has multiple edit points and each shot has its own unique challenges to correct. With, say, Topaz Video AI, if I want to clean up the video shot by shot I need to set the In and Out points for one shot in the video, then set the clean-up prameters and render that one shot. Then scroll in the timeline and reset the In and Out points of the next shot, render, etc. I was wondering if the program could detect the In and Out points of a shot so that if the preview window was anywhere within a shot it could recognize the In and Out edit points, allowing me to skip that part of the very manual process of trying to clean up this video. I'm not sure if that helped.

SECourses

this program has scene detection automatically. so if scene is changing it will split each shot into a scene and process it individually. but we are not building a video editor like davinci resolve.

Clinton

Oh, yes. I do realize that. And what you described is exactly what I was looking for. I would then take the cleaned up video and move it over to Resolve at that stage. Thank you!

SECourses

sure you can get those scenes individually we save all scenes individually as well :)

SECourses

after published we may add sorry for late reply

Darwin Giordano

Is there a time estimate for when it is expected to be published? The result looks very good in the examples.

SECourses

hopefully in 1 week. so sorry for delay i am making presets and few more thing

JP LONB

After the recently published Wan22 Lora tutorial, for which I am very very grateful, the next item on my wish list would be the ultimate video upscaler. Any progress there? Thanks in advance for all your efforts!