Stable WarpFusion v0.5.27 Nightly - embeddings - notebook (Patreon)
Downloads
Missing 1 full-res photo, 2 files, as this post has not yet been imported.
Content
Lo and behold: Embeddings are now supported!
Changelog:
- add embeddings, prompt attention weights from AUTOMATIC1111 webui repo
- bring back colab gui for compatibility
- load default settings option
- add frame difference manual override for content-aware scheduling
- fix PDF color transfer being used by default with LAB selected
- fix content-aware schedules
Embeddings
Added embeddings support from the awesome AUTOMATIC1111 repo.
Place embeddings into embeddings folder that should be ccreated in your warp folder. Embeddings are loaded right after the model itself, so if you add some more files mid-run, make sure to reload the notebook.
You can use embeddings by specifying their filename in the prompt. For example, if you have some_embedding.pt, add some_embedding to your prompt as text to call it.
Prompt attention weights
Added keyword weights support from AUTOMATIC1111 repo.
You can weight keywords and embeddings as well with the following syntax:
(someword:1.1) - increases the weight of that word by 10%,
(someword:0.9) - decreases the weight by 10%.
You can also use () without a number to increase the weight by 10%, or use [] without a number to decrease the weight by 10%
Colab gui is back
Brough back the old colab gui (by popular demand). The new gui is still there, but now its defaults are taken from the old gui, so you can see what defaults you're gonna get.
Load default setings
GUI -> default_settings_path
You can now specify the default settings file that will be loaded. It will override the old-fashioned gui settings.
Frame difference manual override
Content-aware scheduling -> Create schedules from frame difference -> diff_override
You can override the keyframes that were inffered during frame difference analysis with your own list of keyframes, for example obtained from audio to keyframe script.
Fix default color transfer
The default color transfer is now LAB, as is stated in the interface (was PDF even if LAB was selected)
Fix content-aware schedules
Content-aware schedules were applied before the GUI and were effectively overridden by the GUI.
Local install guide:
https://github.com/Sxela/WarpFusion/blob/main/README.md
Quickstart guide if you're new to google colab notebooks: https://docs.google.com/document/d/1gu8qJbRN553SYrYEMScC4i_VA_oThbVZrDVvWkQu3yI
A reminder:
Changes in GUI will not be saved into the notebook, but if you run it with new settings, they will be saved to a settings.txt file as usual.
You can load settings in misc tab.
You do not need to rerun the GUI cell after changing its settings.
A more thorough guide (a bit outdated, but covers most of the warp-specific stuff and local\cloud install): https://docs.google.com/document/d/11xxHyvkCBBUwT73lWHQx-T_FU_rC7HWzNylftyCExcE
For tech support and other questions please join our discord server: https://discord.gg/YrpJRgVcax
Discord is the preferred method, because it is nearly impossible to provide any decent help or tech support via Patreon due its limited text formatting and inability to add screenshots or videos to comments or DMs.
upd:
- fix xformers for a100
- remove PatchMatch to fix jacinle/travis error on colab
- print settings on error while saving settings :D
- reload embeddings in Diffuse! cell (you can add new without reloading the whole model)
- fix pkl not saveable after loading embeddings
- fix xformers install (no need to downgrade torch thanks to TheFastBen)
- add ffmpeg instal for windows
- add torch install/reinstall options for windows
- add xformers install/reinstall for windows
- disable shutdown runtime for non-colab env
- fix error saving settings with content aware schedules
- fix legacy normalize latent = first latent error
- fix xformers install in colab A100
- fix 'load default settings' not working in GUI cell
- fix mask_clip not loading from settings
- fix error with loaded settings' schedules
- fix another error with loaded schedules ("0" vs 0)
Files
Previews only