Home Creators Posts Import Register Favorites Logout

Downloads

Content

Hey everyone! I’ve just released a brand-new video on “The ULTIMATE Local TTS AI Voice Cloning”, featuring the brand-new VibeVoice model. This one is a total game-changer it can clone voices with as little as 10 seconds of audio, generate conversations between up to 4 voices at the same time, and even switch across multiple languages… all running locally on your own computer. 👀🎤

You can check out the video right here: https://youtu.be/XtaPZmlyMMw

I also created a 1-click installer for the Webui for my Patreon supporters for Local AND Runpod, that you can find right here: https://www.patreon.com/posts/139346699As well as the installer for the Vibevoice & RVC webui: https://www.patreon.com/posts/139346683

Here the link to the manual install guide: https://pastebin.com/FX07hPLc

Down below you will also find the VIBEVOICE-RVC_VOICE_CLONING.json for free for you to use!

As always, supporting me on Patreon allows me to keep creating helpful resources like this for the community. Thank you for your support - now go have some fun😉!

Files

Comments

Boyo's Medicine

Just to say as a person with severe Diabetes I know how crap it can be when you are ill, so get well dude and we all appreciate the work you do. Once again another fine workflow delivered to the community.

Brad

How about IndexTTS2 ?

Ech0_Hue

How much Vram it use?, will it work on 4gb vram?

Aitrepreneur

I tried it, not bad but not as good a Vibevoice and EXTREMELY limited, only English and Chines language

Aitrepreneur

Oof...4gb is a bit too low...maybe the 1.5b...but with that I just suggest runpod

Ech0_Hue

The 1.5 and the quantized 7b works, but the quality is very very bad tho, Is that because of memory issue or smth else? Note i tryed it in comfy with 1 speaker

Brad

But does this model let you type text to then hear speech and can it change emotions?

James Charleston II

So getting errors with this specific custom node, which has been fixed in the upstream custom-node which also uses SafeAttention: VibeVoiceMultipleSpeakersNode Error generating multi-speaker speech: VibeVoice generation failed: 'DynamicCache' object has no attribute 'key_cache'

Aitrepreneur

I've heard that disabling sageattention in the run bat file can fixe the issue

Dropbear 21

I tried downloading the large model and got a out of memory error. I have 8 gb of vram. Anything I can do?

Brandon Waters

I'm doing exactly what the video shows, but my output audio sounds nothing like the guy. i ripped the audio from an interview as well.

Magnus Nelénius

I loaded a mp3-file called jenny.mp3 but got this error: Failed to validate prompt for output 595: * LoadAudio 597: - Custom validation failed for node: audio - Invalid audio file: DIOGOOD.wav Output will be ignored invalid prompt: {'type': 'prompt_outputs_failed_validation', 'message': 'Prompt outputs failed validation', 'details': '', 'extra_info': {}} Exception in callback _ProactorBasePipeTransport._call_connection_lost(None) handle: Traceback (most recent call last): File "asyncio\events.py", line 88, in _run File "asyncio\proactor_events.py", line 165, in _call_connection_lost

Vanz Watts

I have tried everything. and when I go to generate it just never goes past zero%. I am not sure what i am doing wrong. I followed the video and read the instructions and still nothing.

Vanz Watts

Stuck at 0% with the below msg using comfi ui For better performance, install the package with: `pip install huggingface_hub[hf_xet]` or `pip install hf_xet` Xet Storage is enabled for this repo, but the 'hf_xet' package is not installed. Falling back to regular HTTP download. For better performance, install the package with: `pip install huggingface_hub[hf_xet]` or `pip install hf_xet` Xet Storage is enabled for this repo, but the 'hf_xet' package is not installed. Falling back to regular HTTP download. For better performance, install the package with: `pip install huggingface_hub[hf_xet]` or `pip install hf_xet`

SmallFox

i ran the autoinstaller but there are no models included. where do i get the VibeVoice model?

Tomi Räsänen

Same (Used the VIBEVOICE-RVC-NODES_INSTALL.bat because I had ComfyUI allready installed)

Cooper Huang

After starting RVC training, an error occurs regardless of whether the graphics card is 4090 or 5090. Does anyone know how to fix this? Traceback (most recent call last): File "multiprocessing\process.py", line 315, in _bootstrap File "multiprocessing\process.py", line 108, in run File "D:\AI\RVC1006Nvidia\infer\modules\train\train.py", line 132, in run dist.init_process_group( File "D:\AI\RVC1006Nvidia\runtime\lib\site-packages\torch\distributed\distributed_c10d.py", line 888, in init_process_group store, rank, world_size = next(rendezvous_iterator) File "D:\AI\RVC1006Nvidia\runtime\lib\site-packages\torch\distributed\rendezvous.py", line 245, in _env_rendezvous_handler store = _create_c10d_store(master_addr, master_port, rank, world_size, timeout) File "D:\AI\RVC1006Nvidia\runtime\lib\site-packages\torch\distributed\rendezvous.py", line 176, in _create_c10d_store return TCPStore( RuntimeError: unmatched '}' in format string

Väinämöinen

Another failed attempt. No models installed. I'm sorry but this is getting silly. The scripts for local install always give problems (gave up on runpod) . I need to spend hours fixing things and trying to locate models etc.. I like the videos you put out but please include clear instructions where to get the models in case your scripts fail to work. I don't mind downloading things manually but I hate to search for them and "guessing"which one is the correct one