Home Creators Posts Import Register Favorites Logout
haven't archived this post yet. have a subscription? use the importer!

Content

A cumulative announcement post for v0.5.12 and v0.5.11
Now getting even closer to some stable Stable Warp version thanks to your support and feedback!
Here's the changelog:

New stuff

Added VRAM usage fix, now supports up to 1536x1536 images on 16gig GPUs
Added VRAM usage fix from this awesome repo - https://github.com/Doggettx/stable-diffusion

It allows running output sizes up to 1536x1536 (or any with the same pixel area) @ 16Gigs of VRAM. Turnin on any loss scales will negate this effect, as computing gradients for loss functions is still memory intensive. 


Added frame range (start-end frame) for video inits
Animation Settings -> Video Input Settings ->
start_frame
end_frame

You can now select a frame range to extract from your videos. 0 end frame means it will use the video's end frame i.e. use the whole video after the start_frame. 


Added pseudo-inpainting by diffusing only inconsistent areas
stable-settings -> mask_result

This setting applies diffusion only to areas deemed inconsistent by the consistency checking script, the other part of the frame is kept intact with respect to flow_blend, and is still warped around


Added Create a video from the init image
Animation Settings ->
use_looped_init_image - enable feature
video_duration_sec -> set video duration (1 sec = ~24 frames)

You can now create a video from your init image. It will be just a looped still image. Useful for testing settings or animating stills and backgrounds.


Added Fixed start code toggle \ blend setting
stable-settings ->
fixed_code - enables the feature
blend_code  - add some random noise back to the fixed noise vector
normalize_code - restores the initial noise range after blending the fixed noise with random (it may drop in range significantly resulting in a blurry image)

Fixed code is analogous to the fixed seed (video seed continuity) setting in DiscoDiffusion, but it only fixes the starting noise added to the init image, so it doesn't have that "behind a dusty window" effect compared to fixing global seed.


Added Latent frame scale
Animation Settings -> Video Input Settings -> Coherency Settings ->
frames_scale

This is a latent init scale loss for frames, similar to the init latent scale


Fixes:
- Fixed changing width-height not working correctly
- Removed LAMA inpainting to reduce load and installation bugs
- Fixed multiple image operations being applied during intermediate previews (even though the previews were not shown)
- Moved Stable model loading to a later stage to allow processings optical flow for larger frame sizes
- Fixed VideoFrames being saved correctly without google drive\locally
- Fixed PIL module error for Colab to work without restarting
- Fixed prompt scheduling
- Returned init scale \ frames scale back to its original menus
- Hidden all unused settings


You can grab v0.5.12 here - https://www.patreon.com/posts/stable-v0-5-12-71655145

P.S. Added settings for that video from twitter here as well

Files

Previews only

Stable WarpFusion 0.5.12

Stable WarpFusion 0.5.12 Settings: { "text_prompts": { "0": [ "a highly detailed matte painting of a No Man's Sky Screenshot, a tall grass field, broken machinery, Simon Stalenhag , featured on Artstation." ], "50": [ "a highly detailed matte painting of a derelict starship, No Man's Sky Screenshot, a tall grass field, broken machinery, Simon Stalenhag , featured on Artstation." ] }, "clip_guidance_scale": 0, "tv_scale": 0, "range_scale": 0, "sat_scale": 0, "cutn_batches": 4, "max_frames": 301, "init_image": "/content/videoplayback (3).png", "init_scale": 0, "skip_steps": 30, "frames_scale": 0, "frames_skip_steps": "70%", "clamp_grad": true, "clamp_max": 0.7, "seed": 4275770367, "fuzzy_prompt": false, "rand_mag": 0.05, "eta": 0.55, "width": 960, "height": 480, "diffusion_model": "stable_diffusion", "steps": 100, "diffusion_steps": 1000, "key_frames": true, "video_init_path": "/content/surfing.mp4", "extract_nth_frame": 1, "flow_video_init_path": null, "flow_extract_nth_frame": 2, "video_init_seed_continuity": false, "turbo_mode": true, "turbo_steps": "3", "turbo_preroll": 1, "flow_warp": true, "flow_blend": 0.999, "check_consistency": true, "turbo_frame_skips_steps": null, "forward_weights_clip": 1, "forward_weights_clip_turbo_step": 1, "disable_cc_for_turbo_frames": false, "padding_ratio": 0.3, "padding_mode": "reflect", "consistency_blur": 2, "inpaint_blend": 0, "match_color_strength": 0, "high_brightness_threshold": 180, "high_brightness_adjust_ratio": 0.97, "low_brightness_threshold": 40, "low_brightness_adjust_ratio": 1.03, "stop_early": 0, "high_brightness_adjust_fix_amount": 2, "low_brightness_adjust_fix_amount": 2, "max_brightness_threshold": 254, "min_brightness_threshold": 1, "enable_adjust_brightness": false, "init_latent_scale": 0, "frames_latent_scale": 0, "cfg_scale": 15, "dynamic_thresh": 2, "warp_interp": 1, "fixed_code": false, "blend_code": 0.2, "normalize_code": true, "mask_result": false }

Comments

vijay sri

torch not compiled with cuda enabled how to fix this in google colab

vijay sri

i am using stable_warpfusion_v0_14_13.ipynb becos Stable WarpFusion v0.5.12 produced same torch not compiled with cuda enabled error