Home Creators Posts Import Register Favorites Logout

Content

MultiTalk turns a static image and audio into talking and singing videos; 4 new ComfyUI workflow categories give better animation at the same VRAM and speed.

Image to video animation is way better compared to before after more than a day of research on 8x A6000 GPUs, with lower VRAM workflows in every folder. Also introduces a lightweight HTML image and video comparison slider app that needs no GPU.

🔗 Newest tutorial ⤵️

▶️ https://youtu.be/wgCtUeog41g

MultiTalk is greatly upgraded. After doing more than 1 day more research with MultiTalk by using 8x A6000 48 GB GPUs, I have significantly improved the MultiTalk workflows and now I am sharing 4 different category workflows with you. VRAM usages and speeds are same but just better quality and animation. Moreover I am introducing a new app which is image and video comparison sliders. Ultra fast and lightweight. Runs as a html app and no GPU is required.

🔗 Main Tutorial That You Have To Watch ⤵️

▶️ https://youtu.be/8cMIwS9qo4M

🔗Follow below link to download the zip file that contains MultiTalk bundle downloader Gradio App - the one used in the tutorial ⤵️

▶️ https://www.patreon.com/posts/SwarmUI-Installer-AI-Videos-Downloader-114517862

🔗Follow below link to download the zip file that contains ComfyUI 1-click installer and the WORKFLOW shown in tutorial that has all the Flash Attention, Sage Attention, xFormers, Triton, DeepSpeed, RTX 5000 series support ⤵️

▶️ https://www.patreon.com/posts/Advanced-ComfyUI-1-Click-Installer-105023709

🔗Follow below link to download the zip file that contains Image and Video Comparison Slider App⤵️

▶️ https://www.patreon.com/posts/Image-Video-Comparison-Slider-App-133935178

🔗 Python, Git, CUDA, C++, FFMPEG, MSVC installation tutorial - needed for ComfyUI ⤵️

▶️ https://youtu.be/DrhUHnYfwC0

🔗 SECourses Official Discord 10500+ Members ⤵️

▶️ https://discord.com/servers/software-engineering-courses-secourses-772774097734074388

🔗 Stable Diffusion, FLUX, Generative AI Tutorials and Resources GitHub ⤵️

▶️ https://github.com/FurkanGozukara/Stable-Diffusion

🔗 SECourses Official Reddit - Stay Subscribed To Learn All The News and More ⤵️

▶️ https://www.reddit.com/r/SECourses/

I am currently looking for video to video lip synching workflow with MultiTalk

Updated Workflows

We have 4 different level of animation and loyalty

Each Folder has the following workflows including lower VRAM GPUs

Video Chapters (MultiTalk Levelled Up - Way Better Animation Compared to Before with New Workflows - Image to Video) : https://youtu.be/wgCtUeog41g

  • 0:00 Introduction to the MultiTalk Tutorial

  • 0:12 One-Click ComfyUI and MultiTalk Installation

  • 0:29 Demonstration of MultiTalk's Singing Animation Capabilities

  • 0:58 VRAM Requirements and Workflow Optimizations

  • 1:12 Overview of the Tutorial Content

  • 1:35 Improvements and New Workflow Options

  • 1:52 How to Update and Use the New SwarmUI and MultiTalk Bundle

  • 2:24 Exploring the New Workflow Presets in ComfyUI

  • 3:08 Downloading and Using the Demo Videos with Embedded Workflows

  • 3:36 Introduction to the New Video and Image Comparison Application

  • 4:00 How to Use the Image Comparison Tool

  • 4:33 How to Use the Video Comparison Tool

  • 5:24 Advanced Upscaling and Comparison Demonstration

  • 6:11 Final Remarks and Where to Find Installation Instructions

Video Chapters (MultiTalk Full Tutorial With 1-Click Installer - Make Talking and Singing Videos From Static Images) : https://youtu.be/8cMIwS9qo4M

By using MeiGen MultiTalk you can generate amazing fully animated real-like videos from given audio input. Not only talking but also animating the body movements is possible. In this video I will show you how to install ComfyUI on Windows and MultiTalk bundle and workflows we prepared with 1-click. Then I will show how to very easily generated amazing videos from these installed workflows. Moreover, I will show our favorite cloud private GPU provider Massed Compute. How to install same there and use it properly. Finally I will show everything on RunPod as well. So whether you are GPU poor or have good GPU, this tutorial covers everything.

  • 0:00 Intro & MultiTalk Showcase

  • 0:28 Singing Animation Showcase

  • 0:57 Tutorial Structure Overview (Windows, Massed Compute, RunPod)

  • 1:10 Windows - Step 1: Download & Extract the Main ZIP File

  • 1:43 Windows - Prerequisites (Python, Git, CUDA, FFmpeg)

  • 2:12 Windows - How to Perform a Fresh Installation (Deleting venv & custom_nodes)

  • 2:42 Windows - Step 2: Running the Main ComfyUI Installer Script

  • 4:24 Windows - Step 3: Installing MultiTalk Nodes & Dependencies

  • 5:05 Windows - Step 4: Downloading Models with the Unified Downloader

  • 6:18 Windows - Tip: Setting Custom Model Paths in ComfyUI

  • 7:18 Windows - Step 5: Updating ComfyUI to the Latest Version

  • 7:39 Windows - Step 6: Launching ComfyUI

  • 7:53 Workflow Usage - Using the 480p 10-Second Workflow

  • 8:07 Workflow Usage - Configuring Basic Parameters (Image, Audio, Resolution)

  • 8:55 Workflow Usage - Optimizing Performance: 'Blocks to Swap' & GPU Monitoring

  • 9:49 Workflow Usage - Crucial Step: Calculating & Setting the Number of Frames

  • 10:48 Workflow Usage - First Generation: Running the 480p Workflow

  • 12:01 Workflow Usage - Troubleshooting: How to Fix 'Out of VRAM' Errors

  • 13:51 Workflow Usage - Introducing the High-Quality Long Context Workflow (720p)

  • 14:09 Workflow Usage - Configuring the 720p 10-Step High-Quality Workflow

  • 16:18 Workflow Usage - Selecting the Correct Model (GGUF) & Attention Mechanism

  • 17:58 Workflow Usage - Improving Results by Changing the Seed

  • 18:36 Workflow Usage - Side-by-Side Comparison: 480p vs 720p High-Quality

  • 20:26 Workflow Usage - Behind the Scenes: How the Intro Videos Were Made

  • 21:32 Part 2: Massed Compute Cloud GPU Tutorial

  • 22:03 Massed Compute - Deploying a GPU Instance (H100)

  • 23:40 Massed Compute - Setting Up the ThinLinc Client & Shared Folder

  • 25:07 Massed Compute - Connecting to the Remote Machine via ThinLinc

  • 26:06 Massed Compute - Transferring Files to the Instance

  • 27:04 Massed Compute - Step 1: Installing ComfyUI

  • 27:39 Massed Compute - Step 2: Installing MultiTalk Nodes

  • 28:11 Massed Compute - Step 3: Downloading Models with Ultra-Fast Speed

  • 30:22 Massed Compute - Step 4: Launching ComfyUI & First Generation

  • 32:45 Massed Compute - Accessing the Remote ComfyUI from Your Local Browser

  • 35:07 Massed Compute - Downloading Generated Videos to Your Local Computer

  • 36:08 Massed Compute - Advanced: Integrating with the Pre-installed SwarmUI

  • 38:06 Massed Compute - Crucial: How to Stop Billing by Deleting the Instance

  • 38:33 Part 3: RunPod Cloud GPU Tutorial

  • 39:29 RunPod - Deploying a Pod (Template, Disk Size, Ports)

  • 40:39 RunPod - Connecting via JupyterLab & Uploading Files

  • 41:11 RunPod - Step 1: Installing ComfyUI

  • 42:32 RunPod - Step 2: Downloading Models

  • 45:26 RunPod - Step 3: Installing MultiTalk Nodes

  • 45:52 RunPod - Step 4: Launching ComfyUI & Connecting via Browser

  • 47:50 RunPod - Running the High-Quality Workflow on the GPU

  • 51:11 RunPod - Understanding the Generation Process on a High-VRAM GPU

  • 52:34 RunPod - Downloading the Final Video to Your Local Machine

  • 53:04 RunPod - How to Stop & Restart a Pod to Save Costs

MultiTalk: Bringing Avatars to Life with Lip-Sync

Complementing WAN 2.1 is MultiTalk, a specialized model for generating talking avatars from images and text or audio inputs. Available on platforms like fal.ai, it offers variants such as single-text for solo avatars, multi-text for conversations, and audio-based syncing. By converting text to speech and ensuring natural lip movements, MultiTalk addresses a key challenge in AI video: realistic dialogue delivery.

When paired with WAN 2.1 in ComfyUI workflows, MultiTalk achieves Veo 3-level lip-sync, enabling local AI video projects with enhanced expressiveness. This integration has been hailed for solving lip-sync issues that plagued earlier models, allowing creators to produce dynamic talking-head videos from static portraits. For instance, workflows turn three images into videos in minutes, ideal for animations or virtual influencers.

Related posts

All posts in this topic: AI Video Generation and Animation Apps · New to SECourses? Start Here: Best and Most Popular SECourses Posts

Files

MultiTalk Levelled Up - Way Better Animation Compared to Before with New Workflows - Image to Video

MultiTalk is greatly upgraded. After doing more than 1 day more research with MultiTalk by using 8x A6000 48 GB GPUs, I have significantly improved the MultiTalk workflows and now I am sharing 4 different category workflows with you. VRAM usages and speeds are same but just better quality and animation. Moreover I am introducing a new app which is image and video comparison sliders. Ultra fast and lightweight. Runs as a html app and no GPU is required. 🔗 Main Tutorial That You Have To Watch ⤵️ ▶️ https://youtu.be/8cMIwS9qo4M 🔗Follow below link to download the zip file that contains MultiTalk bundle downloader Gradio App - the one used in the tutorial ⤵️ ▶️ https://www.patreon.com/posts/SwarmUI-Installer-AI-Videos-Downloader-114517862 🔗Follow below link to download the zip file that contains ComfyUI 1-click installer and the WORKFLOW shown in tutorial that has all the Flash Attention, Sage Attention, xFormers, Triton, DeepSpeed, RTX 5000 series support ⤵️ ▶️ https://www.patreon.com/posts/Advanced-ComfyUI-1-Click-Installer-105023709 🔗Follow below link to download the zip file that contains Image and Video Comparison Slider App⤵️ ▶️ https://www.patreon.com/posts/Image-Video-Comparison-Slider-App-133935178 🔗 Python, Git, CUDA, C++, FFMPEG, MSVC installation tutorial - needed for ComfyUI ⤵️ ▶️ https://youtu.be/DrhUHnYfwC0 🔗 SECourses Official Discord 10500+ Members ⤵️ ▶️ https://discord.com/servers/software-engineering-courses-secourses-772774097734074388 🔗 Stable Diffusion, FLUX, Generative AI Tutorials and Resources GitHub ⤵️ ▶️ https://github.com/FurkanGozukara/Stable-Diffusion 🔗 SECourses Official Reddit - Stay Subscribed To Learn All The News and More ⤵️ ▶️ https://www.reddit.com/r/SECourses/ Video Chapters 0:00 Introduction to the MultiTalk Tutorial 0:12 One-Click ComfyUI and MultiTalk Installation 0:29 Demonstration of MultiTalk's Singing Animation Capabilities 0:58 VRAM Requirements and Workflow Optimizations 1:12 Overview of the Tutorial Content 1:35 Improvements and New Workflow Options 1:52 How to Update and Use the New SwarmUI and MultiTalk Bundle 2:24 Exploring the New Workflow Presets in ComfyUI 3:08 Downloading and Using the Demo Videos with Embedded Workflows 3:36 Introduction to the New Video and Image Comparison Application 4:00 How to Use the Image Comparison Tool 4:33 How to Use the Video Comparison Tool 5:24 Advanced Upscaling and Comparison Demonstration 6:11 Final Remarks and Where to Find Installation Instructions MultiTalk: Bringing Avatars to Life with Lip-Sync Complementing WAN 2.1 is MultiTalk, a specialized model for generating talking avatars from images and text or audio inputs. Available on platforms like fal.ai, it offers variants such as single-text for solo avatars, multi-text for conversations, and audio-based syncing. By converting text to speech and ensuring natural lip movements, MultiTalk addresses a key challenge in AI video: realistic dialogue delivery. When paired with WAN 2.1 in ComfyUI workflows, MultiTalk achieves Veo 3-level lip-sync, enabling local AI video projects with enhanced expressiveness. This integration has been hailed for solving lip-sync issues that plagued earlier models, allowing creators to produce dynamic talking-head videos from static portraits. For instance, workflows turn three images into videos in minutes, ideal for animations or virtual influencers. Veo 3: Google's Leap in Photo-to-Video with Audio Google's Veo 3, integrated into the Gemini app, marks a milestone in I2V by generating eight-second clips with sound from uploaded photos. Launched in May 2025 and expanded to over 150 countries, it allows users to describe scenes, animate objects, or add audio effects, transforming stills into immersive videos. Key features include groundbreaking audio generation with perfect lip-sync, improved motion controls, physics simulation, and style precision. Available to Google AI Pro subscribers, it has generated over 40 million videos, from fairy tale reimaginings to ASMR experiments. Safety measures like SynthID watermarks and red teaming ensure responsible use. Comparative Insights and Future Impact While WAN 2.1 offers open-source flexibility and multi-task efficiency, MultiTalk adds specialized avatar animation, and Veo 3 excels in seamless audio integration and user-friendliness. Together, they democratize video creation, rivaling professional tools. WAN 2.1's local runnability contrasts Veo 3's cloud-based approach, but both achieve high fidelity. As AI evolves, these models hint at a future where anyone can create cinematic content from a single image, blending creativity with technology. With ongoing updates, expect even longer videos and better realism ahead. Some background music by NoCopyrightSounds : https://gist.github.com/FurkanGozukara/681667e5d7051b073f2e795794c46170

Comments

AiInfluence

What is the logic behind "loyal"? I don't understand. Does it mean it is less close to the original kijai workflow ?

Alexandr Mishuk

Could you please share actual render times (seconds per second of output) on: RTX 3090 - 480p 10 second - 5 minute RTX 4090 RTX 5090 NVIDIA H100 Thanks for the awesome content!

100Sachen80

Hi Furkan, could you write a json preset for usage with 32gb system ram and 12gb vram? my system can only handle 32gb ram and with my 3060 12gb i always get a OOM error. i check process explorer and i can see that system ram is maxed out, and then it gives OOM error in comfyui workflow. any chance for optimization? i use your 480p low vram 6000mb preset, still error.

SECourses

sadly there is no way to go lower. you can try Q4 GGUF. please let me know. also did you set 100 gb virtual ram?

SECourses

thanks i will do if i can find time

SECourses

loyal = original kijai and keeps the original image very alike. others may change original image for example like the face of the person

Jon Flaherty (edited)

Comment edits

2026-09-07 10:00 This is great! More of these comfyui workflows please for folks that want to do some things you can't do in swarm!
2025-07-15 23:15

Alexandr Mishuk

Can you make such a project for google colab ? Because on massedcompute you have to delete the project all the time not to be left without balance, and every time re-configuring it is not convenient.

100Sachen80

Hi Furkan, unfortunately that did not work. I set 100 gb virtual ram.

SECourses

then your only chance is upgrading RAM

SECourses

google colab only paid one would work and i don't plan to cover it since maintaince is huge time for me

Alexandr Mishuk

Merhaba tekrardan , Multıtalk Colab da calisacak sekilde hazir halde ne kadara yapabilirsiniz? Ucretini soylerseniz odeme yapabilirim

SECourses

colab niye lazım mı massed compute ve runpod çalışıyor zaten

Tyler

[update - it appears there was an update that broke lora merging for wan in comfyui... This kills the WF entirely:/ is there a non-gguf version you have availbale? trying to get it to work but errors all over. I don't see a fusionx model that's not gguf to swap in... plz help! ] Did this break recently for anyone else? I'm starting to get a new error saying that you cannot merge LORAs with a gguf model (I was adding on more loras in the past, no issue)... I'm now turning off the toggle on lora loaders to not merge them, but the lip sync is still not happening at all... anyone know what happened? Or did a recent comfyUI update break it? Please lmk!

SECourses

yes if you update nodes it will break. so make a seperate comfyui and use my node installer. it will work.

Tyler

I swapped in a WAN14BI2VFusionX 16 gb model to get away from the gguf and it still failed to generate a video with lip sync... Is multitalk just broken now overall? What are the options to get it working again? (Would only an older version of comfyUI work now? That wouldn't be great...)

Tyler

ahh, so make a new file folder with your comfyUI again (sry which version? and use only that for multitalk*) (I see V40 which I origianlly used, and you're at v52 for comfyUI now.. is that the file to run( v40 or v52? or is your 'node installer' different?

Tyler

Okay sry where is your node installer? I have v40 and v52 from your auto comfyui installer zip. Not sure how to update/install nodes to get multitalk working from somethign you've provided?*

SECourses

well it works but you have to use installer. if you use latest node it is broken. sadly it is impossible to keep updating workflows since kijai constantly breaking older workflows. my installation working as in the tutorial video : https://youtu.be/8cMIwS9qo4M

Tyler

Thank you! I got it working. Yes your videos are fantastic, tysm! Also, Multitalk was origianlly advertised as Multiple Characters talking... Any idea if they'll ever realease the multiple characters driven from one audio models?

Tyler

But multitalk takes input audio to drive. Ovi only creates the audio. Multitalk taking one or two input audios and driving 2 characters would be huge, alas it never released from what I can see.

SECourses

i didn't see kijai has such workflow sadly

Tyler

Hello, is there any update for multitalk with Wan2.2? These workflows were fantastic, would be amazing if they got another upgrade! Please lmk if conversion to 2.2 is possible/easy.

SECourses

No upgrade yet but i should check soon hopefully