Home Creators Posts Import Register Favorites Logout

Content

ComfyUI and SwarmUI on RunPod, step by step: install both with 1 click, connect ComfyUI as the SwarmUI backend and generate FLUX images and Wan 2.1 videos.

The ultimate RunPod guide, shown on an RTX PRO 6000, with the addition of RTX 5000 series GPUs. The installers set up Torch 2.7, CUDA 12.8, xFormers, Sage Attention, Flash Attention, Triton and DeepSpeed, plus the unified model downloader.

Tutorial Link : https://youtu.be/R02kPf9Y3_w

If you want to use ComfyUI or SwarmUI with ComfyUI backend on RunPod cloud platform, this is the ultimate tutorial that you will find to step by step install ComfyUI and SwarmUI on RunPod and use each one of them. RunPod is a great platform to scale your AI generation or if you are a GPU poor, rent the very best GPUs and leverage the AI in your profession. ComfyUI is the ultimate ecosystem right now for Image and Video generation models and with SwarmUI interface leveraging ComfyUI, you can become master for gen AI. So learn how to install ComfyUI on RunPod step by step and run it. Then learn how to install SwarmUI on RunPod step by step and learn how to use it. Then learn how to give installed ComfyUI backend to SwarmUI and leverage its features and ultimate performance and optimizations. Moreover, the installers I made installs Torch 2.7, CUDA 12.8, xFormers, Sage Attention, Flash Attention, Accelerate, Triton, DeepSpeed, ComfyUI manager and moıre.

🔗ComfyUI Installer Zip File Download ⤵️

🔗SwarmUI Installer and Model Downloader Zip File Download ⤵️

▶️ Download & Upload Models Tutorial (wget) : https://youtu.be/X5WVZ0NMaTg

▶️ CausVid LoRA V2 Tutorial : https://youtu.be/1rAwZv0hEcU

▶️ CausVid Main Tutorial : https://youtu.be/fTzlQ0tjxj0

▶️ SwarmUI Master Tutorial : https://youtu.be/HKX8_F1Er_w

🔗 SECourses Official Discord 10500+ Members ⤵️

🔗 Stable Diffusion, FLUX, Generative AI Tutorials and Resources GitHub ⤵️

🔗 SECourses Official Reddit - Stay Subscribed To Learn All The News and More ⤵️

Video Chapters

  • 0:00 Introduction to ComfyUI & SwarmUI Installation on RunPod

  • 0:22 Advanced Features of the One-Click Installer (Sage Attention, xFormers, Blackwell)

  • 1:03 Demonstration on RTX Pro 6000 GPU & VRAM Optimization

  • 1:52 Introducing the High-Speed Unified Model Downloader

  • 2:06 Starting the Tutorial: Downloading & Preparing the Installer Files

  • 2:45 Registering and Setting Up Your RunPod Account & Billing

  • 3:04 Selecting the Optimal RunPod GPU (RTX Pro 6000) and Server

  • 3:54 Critical Step: Configuring the RunPod Pod Template (PyTorch 2.2.0)

  • 4:20 Setting Volume Disk, Container Disk, and Exposing HTTP Ports

  • 5:09 Deploying the Pod and Accessing the Jupyter Lab Interface

  • 5:46 Uploading and Extracting the ComfyUI Installer on RunPod

  • 6:16 Running the ComfyUI Installation Command in the Terminal

  • 7:22 How to Start ComfyUI with Custom Launch Arguments (e.g., --gpu-only)

  • 8:13 Overview of Included Libraries (Manager, Flash Attention, DeepSpeed, Triton)

  • 9:15 Using Sage Attention vs. xFormers for Optimal Performance

  • 9:42 Connecting to the Live ComfyUI Web Interface

  • 10:27 Introducing the Unified Model Downloader for ComfyUI & SwarmUI

  • 11:01 Running the Model Downloader and Configuring the Download Path

  • 11:43 Downloading FLUX Models for a ComfyUI Image Generation Test

  • 13:22 Configuring the ComfyUI Workflow with Newly Downloaded FLUX Models

  • 15:01 First Image Generation Test: Analyzing the Incredible Speed

  • 15:53 Terminating ComfyUI and Preparing for SwarmUI Installation

  • 16:25 Installing SwarmUI and Setting it Up via the Cloudflared Link

  • 16:50 How to Configure SwarmUI to Use ComfyUI as a Self-Starting Backend

  • 17:50 Downloading Wan 2.1 Video Generation Models with the Downloader

  • 19:22 Importing Presets and Setting up a Wan 2.1 Video Generation in SwarmUI

  • 20:21 First Video Generation Test with Wan 2.1 (GGUF Version)

  • 21:26 Analyzing GGUF Performance and Deciding to Test the FP16 Model

  • 22:54 Downloading the FP16 Wan 2.1 Model for a Performance Comparison

  • 24:01 Installing Extra Features like RIFE Frame Interpolation

  • 24:41 Re-configuring SwarmUI to Use the FP16 Model with 16-bit Precision

  • 25:52 Analyzing FP16 Performance and VRAM Usage (57GB)

  • 26:28 Final Experiment: Using the Official Wan 2.1 Preset for Best Results

  • 27:28 Final Results, Conclusion, and How to Get Further Help

ComfyUI: A Powerful Tool for Creative Workflows

ComfyUI is an open-source, node-based interface for Stable Diffusion, enabling users to create complex generative art and image processing workflows. Its modular design allows for intuitive drag-and-drop connections, making it accessible for artists and developers. With extensive customization, plugin support, and a vibrant community, ComfyUI empowers users to experiment with AI-driven creativity efficiently.

Related posts

All posts in this topic: Cloud GPU Guides: RunPod, Massed Compute, SimplePod, Kaggle · New to SECourses? Start Here: Best and Most Popular SECourses Posts

Files

Ultimate ComfyUI & SwarmUI on RunPod Tutorial with Addition RTX 5000 Series GPUs & 1-Click to Setup

If you want to use ComfyUI or SwarmUI with ComfyUI backend on RunPod cloud platform, this is the ultimate tutorial that you will find to step by step install ComfyUI and SwarmUI on RunPod and use each one of them. RunPod is a great platform to scale your AI generation or if you are a GPU poor, rent the very best GPUs and leverage the AI in your profession. ComfyUI is the ultimate ecosystem right now for Image and Video generation models and with SwarmUI interface leveraging ComfyUI, you can become master for gen AI. So learn how to install ComfyUI on RunPod step by step and run it. Then learn how to install SwarmUI on RunPod step by step and learn how to use it. Then learn how to give installed ComfyUI backend to SwarmUI and leverage its features and ultimate performance and optimizations. Moreover, the installers I made installs Torch 2.7, CUDA 12.8, xFormers, Sage Attention, Flash Attention, Accelerate, Triton, DeepSpeed, ComfyUI manager and moıre. 🔗ComfyUI Installer Zip File Download ⤵️ ▶️ https://www.patreon.com/posts/Advanced-ComfyUI-1-Click-Installer-105023709 🔗SwarmUI Installer and Model Downloader Zip File Download ⤵️ ▶️ https://www.patreon.com/posts/SwarmUI-Installer-AI-Videos-Downloader-114517862 ▶️ Download & Upload Models Tutorial (wget) : https://youtu.be/X5WVZ0NMaTg ▶️ CausVid LoRA V2 Tutorial : https://youtu.be/1rAwZv0hEcU ▶️ CausVid Main Tutorial : https://youtu.be/fTzlQ0tjxj0 ▶️ SwarmUI Master Tutorial : https://youtu.be/HKX8_F1Er_w 🔗 SECourses Official Discord 10500+ Members ⤵️ ▶️ https://discord.com/servers/software-engineering-courses-secourses-772774097734074388 🔗 Stable Diffusion, FLUX, Generative AI Tutorials and Resources GitHub ⤵️ ▶️ https://github.com/FurkanGozukara/Stable-Diffusion 🔗 SECourses Official Reddit - Stay Subscribed To Learn All The News and More ⤵️ ▶️ https://www.reddit.com/r/SECourses/ Video Chapters 0:00 Introduction to ComfyUI & SwarmUI Installation on RunPod 0:22 Advanced Features of the One-Click Installer (Sage Attention, xFormers, Blackwell) 1:03 Demonstration on RTX Pro 6000 GPU & VRAM Optimization 1:52 Introducing the High-Speed Unified Model Downloader 2:06 Starting the Tutorial: Downloading & Preparing the Installer Files 2:45 Registering and Setting Up Your RunPod Account & Billing 3:04 Selecting the Optimal RunPod GPU (RTX Pro 6000) and Server 3:54 Critical Step: Configuring the RunPod Pod Template (PyTorch 2.2.0) 4:20 Setting Volume Disk, Container Disk, and Exposing HTTP Ports 5:09 Deploying the Pod and Accessing the Jupyter Lab Interface 5:46 Uploading and Extracting the ComfyUI Installer on RunPod 6:16 Running the ComfyUI Installation Command in the Terminal 7:22 How to Start ComfyUI with Custom Launch Arguments (e.g., --gpu-only) 8:13 Overview of Included Libraries (Manager, Flash Attention, DeepSpeed, Triton) 9:15 Using Sage Attention vs. xFormers for Optimal Performance 9:42 Connecting to the Live ComfyUI Web Interface 10:27 Introducing the Unified Model Downloader for ComfyUI & SwarmUI 11:01 Running the Model Downloader and Configuring the Download Path 11:43 Downloading FLUX Models for a ComfyUI Image Generation Test 13:22 Configuring the ComfyUI Workflow with Newly Downloaded FLUX Models 15:01 First Image Generation Test: Analyzing the Incredible Speed 15:53 Terminating ComfyUI and Preparing for SwarmUI Installation 16:25 Installing SwarmUI and Setting it Up via the Cloudflared Link 16:50 How to Configure SwarmUI to Use ComfyUI as a Self-Starting Backend 17:50 Downloading Wan 2.1 Video Generation Models with the Downloader 19:22 Importing Presets and Setting up a Wan 2.1 Video Generation in SwarmUI 20:21 First Video Generation Test with Wan 2.1 (GGUF Version) 21:26 Analyzing GGUF Performance and Deciding to Test the FP16 Model 22:54 Downloading the FP16 Wan 2.1 Model for a Performance Comparison 24:01 Installing Extra Features like RIFE Frame Interpolation 24:41 Re-configuring SwarmUI to Use the FP16 Model with 16-bit Precision 25:52 Analyzing FP16 Performance and VRAM Usage (57GB) 26:28 Final Experiment: Using the Official Wan 2.1 Preset for Best Results 27:28 Final Results, Conclusion, and How to Get Further Help ComfyUI: A Powerful Tool for Creative Workflows ComfyUI is an open-source, node-based interface for Stable Diffusion, enabling users to create complex generative art and image processing workflows. Its modular design allows for intuitive drag-and-drop connections, making it accessible for artists and developers. With extensive customization, plugin support, and a vibrant community, ComfyUI empowers users to experiment with AI-driven creativity efficiently. Some background music by NoCopyrightSounds : https://gist.github.com/FurkanGozukara/681667e5d7051b073f2e795794c46170

Comments

Yannis

Thank you !

Yannis

Everything went smoothly during install but I'm having frequent disconnection from the backend : 10:08:30.547 [Error] Final error (4) while initializing backend #0 - ComfyUI Self-Starting, giving up: System.IO.FileNotFoundException: Could not find file '/requirements.txt'. File name: '/requirements.txt' at Interop.ThrowExceptionForIoErrno(ErrorInfo errorInfo, String path, Boolean isDirError) at Microsoft.Win32.SafeHandles.SafeFileHandle.Open(String fullPath, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, UnixFileMode openPermissions, Int64& fileLength, UnixFileMode& filePermissions, Boolean failForSymlink, Boolean& wasSymlink, Func`4 createOpenException) at System.IO.Strategies.OSFileStreamStrategy..ctor(String path, FileMode mode, FileAccess access, FileShare share, FileOptions options, Int64 preallocationSize, Nullable`1 unixCreateMode) at System.IO.File.ReadAllLines(String path, Encoding encoding) at SwarmUI.Builtin_ComfyUIBackend.ComfyUISelfStartBackend.Init() in /SwarmUI/src/BuiltinExtensions/ComfyUIBackend/ComfyUISelfStartBackend.cs:line 400 at SwarmUI.Backends.BackendHandler.LoadBackendDirect(T2IBackendData data) in /SwarmUI/src/Backends/BackendHandler.cs:line 507 10:09:12.591 [Warning] User local requested edit of backend 0. 10:09:12.593 [Info] ComfyUI backend 0 shutting down... 10:09:14.551 [Init] Initializing backend #0 - ComfyUI Self-Starting... 10:09:19.910 [Info] Saving backends... 10:09:23.604 [Info] Self-Start ComfyUI (Install imageio-ffmpeg) exited properly. 10:09:29.145 [Init] Self-Start ComfyUI-0 on port 7821 is loading... 10:09:30.122 [Info] Self-Start ComfyUI (Update comfyui_frontend_package) exited properly. 10:10:10.190 [Warning] Comfy backend 0 has failed to load value set repeatedly. Is it stuck loading very slowly, or has it internally failed? Ignoring errors of HttpRequestException: Connection refused (localhost:7821)

SECourses

ye runpod sucks i really prefer massed compute

Yannis

The one thing you don't explain is how to start again swarm each time (im using a network storage). Can you share the code lines ? Thanks

SECourses

same code. it will just start and skip install part since installed

Yannis

it restarted a full install of swarmui using the same code

SECourses

no it wont. because you will already have SwarmUI cloned. it will install .net libraries. just proceed

Yannis

Is there anything we can do to stabilize the backend connection ? I have this and it's loading forever : Comfy backend 0 has failed to load value set repeatedly. Is it stuck loading very slowly, or has it internally failed? Ignoring errors of HttpRequestException: Connection refused (localhost:7821)

SECourses

sadly not. it is due to runpod unfortunately :(