Home
Creators
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register Favorites Keys Review DMs Logout
Community
Telegram ThePornDude
Home Creators Posts Import Register Favorites Logout

Voice Clone Tutorial Scripts (Patreon)

Published:
2023-05-08 20:48:05
Edited:
2023-06-10 16:05:30
Imported:
2026-06
Tags:

Downloads

Content

Tutorial published : https://youtu.be/OiMRlqcgDL0

GitHub file link that has many instructions (the one used in the video) : https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Tutorials/Deep-Voice-Clone-Tutorial-Tortoise-TTS.md

pre_process_given_text_file. py will be used by process_given_speech_text.bat automatically to preprocess and fix prepare your speech text file.

process_given_speech_text.bat will automate your process. just drag and drop your speech txt file into it.

epoch_comparison.bat will automate your process and will generate speech files from given text file by using all of the checkpoint files you put in the given folder. it also works with drag and drop the text file

put both files into the same folder. Don't forget to modify necessary variables as explained in the GitHub repo and in the tutorial video

setting up the necessary variables are mandatory in the given files so check out video or GitHub page

fixDuration.py this is a new file. With this file you can remove bigger than any length  sounds. For example it will remove above 12 seconds right now. Run this script inside the training set folder which have wavs folder, train.txt and valid.txt files.  Moreover in ozen toolkit, you can change config.ini file and set seg_min_duration = 5.0 for removing smaller than 5 second speech files automatically. But this will also make you lose a lot of speech parts. You can change valid_ratio , seg_onset , and seg_offset  values in ozen toolkit config.ini to see what kind of effects they are making when pre processing given speech audio file. 

Comments

Valics Lehel

Can be trained other languages as well, not only EN? For example HU or RO?

Alex Sims

Im a little confused. I got all the scripts set up with my directories but I think I am missing something in the video. Where do I put my speech text for the script to preprocess it?

Alex Sims

Nevermind, I must have missed the part up top where it says to drag the file onto the script.

Alex Sims

How do I continue training from an earlier instance? I swear I have watched the video at least 6 times and I am not catching it. There is a part where you mention needing to save so you can continue later but I didn't catch an explanation. Just loading the config and and using the same name doesn't work because it just appends numbers onto the name. By the way you are the definitive channel for ai tutorials. You are the only channel I go to for instructions now. I went from knowing nothing to using A1111, dreambooth, controlnet, deforum etc. etc.

Alex Sims

I can't believe I missed that. It has the same dummy path that was listed in the yaml and everything and I must have looked at it a hundred times. Thanks.

Mark Wrangler

Thanks for the excellent training video. When I run the pre_process_given_text_file.py the result does not put ";" in the output file. Not sure what I am missing. Any suggestions?

Mark Wrangler

I was only trying to run pre_process_given_text_file.py standalone to check the result but there are no separators in the file.

Jessica

Nevermind - I did your steps in order without trying to start DLAS and it is working so far :D Is this user warning fatal though? 38: UserWarning: Detected call of `lr_scheduler.step()` before `optimizer.step()`. In PyTorch 1.1.0 and later, you should call them in the opposite order: `optimizer.step()` before `lr_scheduler.step()`. Failure to do this will result in PyTorch skipping the first value of the learning rate schedule. See more details at https://pytorch.org/docs/stable/optim.html#how-to-adjust-learning-rate warnings.warn("Detected call of `lr_scheduler.step()` before `optimizer.step()`. "

Jessica

Ok- so my computer stopped after about 6 weeks of training because of a power outage. It got to 11400_gt.pth and 11400.state - is there a way to restart it or go with what I already have?

SECourses: FLUX, Tutorials, Guides, Resources, Training, Scripts

yes there is a way to resume. in the gui you give a path of pth. you can give your last checkpoint. by the way coqui is much faster and better. for 150$ private session, i can share my prepared scripts and show you how to voice clone training. i will hopefully make a tutorial but not ready yet.