Home Creators Posts Import Register Favorites Logout

Videos

  • example_driving_video_SECourses_73_seconds.mp4

Downloads

Content

LivePortrait animates a static image or video into a talking, moving portrait, blazing fast: 20 seconds of animation in under 50 seconds on an RTX 3090.

Note: this is an older post kept for reference. The current, maintained version is LivePortrait Human & Animal 1-Click Installers for Windows & Cloud.

Upgraded app with image to video and video to video modes, animal animation, eye and lip open ratio control and 1-click installers for Windows, RunPod, Massed Compute and Kaggle. No longer maintained; the post points to the newer LivePortrait installer post.

New post is here use this one : https://www.patreon.com/posts/119254105

Use new post : https://www.patreon.com/posts/119254105

This post no longer maintained

Use new one : https://www.patreon.com/posts/119254105

Patreon exclusive posts index to find our scripts easily, Patreon scripts updates history to see which updates arrived to which scripts and amazing Patreon special generative scripts list that you can use in any of your task.

Join discord to get help, chat, discuss and also tell me your discord username to get your special rank : SECourses Discord

Please also Star, Watch and Fork our Stable Diffusion & Generative AI  GitHub repository and join our Reddit subreddit and follow me on LinkedIn (my real profile)

=======

LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control

This is the newest open source project even better than the paid apps. Its speed is mind blowing. Like you can generate 20 seconds animation in lesser than 50 seconds with RTX 3090.

This is the official repository ( https://github.com/KwaiVGI/LivePortrait ) 

27 October 2024

  • Updated to V11 installer : LP_V12.zip

  • Upgraded to Torch 2.5 and xFormers 0.0.28.post2 and Triton 3.1 and ONNX GPU 1.19.0 both for Windows and Linux

  • New Windows requirements are CUDA 12.4, cuDNN 8.9.7, C++ Tools, Git, FFMPEG

  • Tested on Windows, RunPod and Massed Compute

    • For RunPod new mandatory template is :

      • RunPod Pytorch 2.2.0

      • runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04

  • If you get cuDNN related error, try different onnx-gpu version like

    • pip install onnxruntime-gpu==1.17.1 or pip install onnxruntime-gpu==1.19.2 and such

    • This error happens due to cuDNN version mismatch

  • You have to use a short installation path like C:\LP_V11 

    • Otherwise you will get very long path error

8 August 2024

  • Animals Live animation added

22 July 2024

  • Updated to V4

  • Source maximum dimension option added

  • So let's say you can modify 1920x1080p video and get same output resolution

  • If you have installed V3 just run Windows_Update_Version.bat file. Zip file still same

21 July 2024

  • Please make a fresh install since we changed the GitHub repository

  • A lot of bugs fixed

  • Video to video option added

  • Working amazing just try it

  • For video to video, don't forget to pick video 🎞️ Source Video in the step 1 when uploading source

10 July 2024 Update

  • Full Windows tutorial with manually written captions / subtitles and video chapters published

  • 🔗 https://youtu.be/FPtpNrmuwXk

  • Full Cloud (Mac users follow this) Tutorial for Massed Compute, RunPod & Kaggle with manually written captions / subtitles and video chapters published

  • 🔗 https://youtu.be/wG7oPp01COg

  • If you also upvote this Reddit Post I appreciate that very much

8 July 2024 Update

Our New Features

  • Fixed FPS issue

  • Audio is automatically saved in output videos

  • Output video naming improved and overwriting previous files issue fixed

  • Open folders tab added (works on Windows and desktop Linux systems)

  • New feature Target Eye Lip Open Ratio added

  • When this is enabled, you can change the opening rate of mouth and the eyelid. However when this is enabled, the movement of the head is currently lost and not maintained.

  • 1-Click to install on Windows, RunPod, Massed Compute and Kaggle.

How to Use

  • Extract attached zip file and install and use on your desired platform.

  • The generated animations will be automatically saved inside animations folder.

Requirements for Windows

Cloud Requirements

  • Full Cloud (Mac users follow this) tutorial for Massed Compute, RunPod and Kaggle : https://youtu.be/wG7oPp01COg

  • Windows tutorial : https://youtu.be/FPtpNrmuwXk

  • For RunPod and Massed Compute follow instructions inside the zip file.

  • You will see Massed_Compute_Instructions_READ.txt and Runpod_Instructions_READ.txt files.

  • For Kaggle follow instructions on the Kaggle notebook.

  • To be able to use Kaggle notebook get a free account and verify your phone number.

  • Zip file also has demo material so you can quickly test. 

  • Upload / download big files / models on cloud via Hugging Face tutorial : https://youtu.be/X5WVZ0NMaTg

  • How to use permanent storage system of RunPod (storage network volume) : https://youtu.be/8Qf4x3-DFf4

  • Massive RunPod tutorial (shows runpodctl) : https://youtu.be/QN1vdGhjcRc 

Usage Tips

  • If you feel the animated video has some jitter, please adjust the driving_smooth_observation_variance parameter in src/config/argument_config.py. We recommend that you change it by a factor of 10. For example, if the current value is 3e-7 and you feel the animated result is a bit jittery, you can adjust it to 3e-6, and so on. If you are using app.py, the corresponding adjustment location is motion smooth strength (v2v).

  • What does cropping do : https://github.com/KwaiVGI/LivePortrait/issues/187#issuecomment-2242107784

  • In the driving video first frame must have mouth closed - not open, not smiling, not showing teeths etc

  •  

Related posts

All posts in this topic: Face Swap, Deepfake and Talking Avatar Apps · New to SECourses? Start Here: Best and Most Popular SECourses Posts

Files

Comments

Dazzastrous

fantstic very fast with this Doc, amazing work bringing it to runpod etc so more can enjoy

jonathan sanchez

fantastic tools, thans you. now that the turkish national team has been eliminated from the european championship you will have more time to bring us more and cooler tools hahahaha ;)

Sergiy Dovgal

Why is the resolution adapted to square? Is it possible to add a resolution change? In Comfyui even when the resolution of files does not match it generates normally.

SECourses

it generates same resolution of input image for me with paste back feature. you can try without do-crop and paste-back to see

Alexandru Naftanaila

Hey. i have this error when i try to use camera : "The input source portrait or driving video hasn't been prepared yet 💥!"

SECourses

that means upload of the video is not completed yet. wait for video upload to be completed to gradio and it shall work

Douglas

Another great job! I installed v1 and then I just saw v2 link and installed, but could you please confirm if in the gradio when running it is suppose to say also V2. Both of my installs say v1 in the gradio title where it reads " This is the official gradio demo for LIvePortrait improved version by SECourses V1"

Douglas

make sure you click on red rec button again. That happened to me it was still recording while I thought I clicked on it , so you must confirm to stop recording then it is prepared to animate

SECourses

Gradio still says V1 true. just run windows updater that is it :D

hacbachvotinh

Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'D:\temp\gradio\3d58cc0bedbf8fd0dec70a1178f4312bf9682855\d0.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf58.29.100 Duration: 00:00:03.12, start: 0.000000, bitrate: 7585 kb/s Stream #1:0[0x1](und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(progressive), 512x512, 7581 kb/s, 25 fps, 25 tbr, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] Stream map '1:a' matches no streams. To ignore this, add a trailing '?' to the map. Failed to set value '1:a' for option 'map': Invalid argument Error parsing options for output file animations/s6_sound_0001.mp4. Error opening output files: Invalid argument Error occurred: Command '['ffmpeg', '-y', '-i', 'animations/s6_0001.mp4', '-i', 'D:\\temp\\gradio\\3d58cc0bedbf8fd0dec70a1178f4312bf9682855\\d0.mp4', '-map', '0:v', '-map', '1:a', '-c:v', 'copy', '-shortest', 'animations/s6_sound_0001.mp4']' returned non-zero exit status 4294967274. i got this error.

SECourses

Your video don't have any sound? Did you test demo material? Demo material works?

SECourses

Yes this happens due to that your video doesn't have any audio. Add some fake audio to it or wait for me to fix which I can't do right now. I am out of home right now

Mike

The timing of this post is amazing for me - I was looking for a way to animate my character and nothing I found looked as good as this

SECourses

just updated and fixed this issue. please run windows update and restart app and it should be fixed now. let me know please

SECourses

just updated and fixed this issue. please run windows update and restart app and it should be fixed now. let me know please

Mark Sutherland

Brilliant work as always, any chance of a one click installer for PaintsUndo

SECourses

Hello. Sure hopefully I can make but I am out of city for my cousins wedding. So it has to wait. Can you remind me again in 1 week please?

Mark Sutherland

Enjoy the wedding, I will add a reply in a weeks time, thank you

daniel mendoza

[WinError 2] The system cannot find the specified file. This dont save the video

SECourses

Do you have ffmpeg installed please verify and let me know. Also send me entire cmd output

SECourses

thanks. not yet but hopefully i will. i am out of city until 18th july

hacbachvotinh

Thank you it works fine. I also encountered this same error in supir and I posted the error in the comment section of the supir post.

SECourses

ye i know supir error still exists. i replied there. thank you

jamzsam

I heard they are adding video to this very soon. That would make it an even more outstanding tool. Great for music videos.

SECourses

Yes I am following to update our script. Also onnx huge speed up coming too

Guile Lindroth

Great work! When running the file "Windows_Start_app.bat" the gradio UI opens and I can select image and video, but when clicking on Run, I'm getting the error: global loadsave.cpp:241 cv::findDecoder imread_('C:\Users\Usu├írio\AppData\Local\Temp\gradio\bef81c8bfee48fec27ef2aef06cf22f20ce3848b\s7.jpeg'): can't open/read file: check file path/integrity I believe this is due to my Windows language being in Portuguese, and the system path to the images is: C:\Users\Usuário\AppData\Local\Temp\gradio Note that I have an accent in the "a" from the path "Usuário" word. Is there a workaround to fix that? ***Solved**** The fix is very simple. Open your Windows Environment Variables and change the "Temp" path to any folder without accented Unicode characters

SECourses

i was gonna tell this Usuário. your username is a big red flag. i am glad you solved :)

Guile Lindroth

Thank you! I’m really impressed with your work, professionalism and dedication with your tutorials and the way you treat your students! Congrats! Regarding my issue, I believe we could write a Python code to sanitize those paths. I think this will help people who have their native computer OS language with those especial characters. Keep the great work!

SECourses

Thank you so much. Also thank you so much to the patreon upgrade. The issue there are so many depended libraries that we can't fix so best to avoid such path :/

Mark Sutherland

Reminder as promised, I think it's called PaintsUndo, cheers

SECourses

thanks a lot i just returned today. i should publish tomorrow adding to list

Mark Sutherland

Brilliant thank you very much for your hard work on this, awesome, thanks again and have a great day

jamzsam

I can't find the LivePortrait link for V3

SECourses

just fixed please refresh the page.

J D

Thank you so much!!!

J D

EchoMimic looks very promising - would love to see this as a 1-click install or something like it that animates the head based on the audio

Mark Hernandez

I had Live Portrait v3 installed. I extracted and replaced the files from v5 into the existing v3 folder. Then I ran the two .bat files: Run Windows_Update_Version.bat file Run Windows_Install.bat - will only download new models and new requirements When trying to load, I get file not found errors.

Mark Hernandez

I deleted everything and downloaded and installed the new v5 version. After running, I can select the 'Human Live Portrait' option and it works. The 'Animal Live Portrait' option doesn't load and gives errors: Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 2 Starting Animal Live Portrait... [10:58:06] Load appearance_feature_extractor from live_portrait_wrapper.py:361 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\appearance_feature_extractor.pth done. Load motion_extractor from live_portrait_wrapper.py:364 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\motion_extractor.pth done. Load warping_module from live_portrait_wrapper.py:367 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\warping_module.pth done. [10:58:07] Load spade_generator from live_portrait_wrapper.py:370 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait_animals\base_mo dels\spade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:374 D:\Live_Portrait_V5\LivePortrait\pretrained_weights\liveportrait\retargeting_mod els\stitching_retargeting_module.pth done. [10:58:08] FaceAnalysisDIY warmup time: 1.076s face_analysis_diy.py:79 [10:58:09] LandmarkRunner warmup time: 0.788s human_landmark_runner.py:95 Traceback (most recent call last): File "D:\Live_Portrait_V5\LivePortrait\app_animals.py", line 62, in gradio_pipeline_animal: GradioPipelineAnimal = GradioPipelineAnimal( File "D:\Live_Portrait_V5\LivePortrait\src\gradio_pipeline.py", line 516, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\Live_Portrait_V5\LivePortrait\src\live_portrait_pipeline_animal.py", line 55, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg, image_type='animal_face', flag_use_half_precision=inference_cfg.flag_use_half_precision) File "D:\Live_Portrait_V5\LivePortrait\src\utils\cropper.py", line 79, in __init__ from .animal_landmark_runner import XPoseRunner as AnimalLandmarkRunner File "D:\Live_Portrait_V5\LivePortrait\src\utils\animal_landmark_runner.py", line 19, in from .dependencies.XPose.models import build_model File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\__init__.py", line 7, in from .UniPose.unipose import build_unipose File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\__init__.py", line 10, in from .unipose import build_unipose File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\unipose.py", line 23, in from .deformable_transformer import build_deformable_transformer File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\deformable_transformer.py", line 30, in from .ops.modules import MSDeformAttn File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\modules\__init__.py", line 9, in from .ms_deform_attn import MSDeformAttn File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\modules\ms_deform_attn.py", line 23, in from src.utils.dependencies.XPose.models.UniPose.ops.functions.ms_deform_attn_func import MSDeformAttnFunction File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\functions\__init__.py", line 9, in from .ms_deform_attn_func import MSDeformAttnFunction File "D:\Live_Portrait_V5\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\functions\ms_deform_attn_func.py", line 18, in import MultiScaleDeformableAttention as MSDA ModuleNotFoundError: No module named 'MultiScaleDeformableAttention' Press any key to continue . . .

SECourses

you need accurate c++ tools and cuda. i replied you from discord

Juuso A

i have the same problem..

Mike

Live Portrait V5_v2 broke, I get a connection error. "Exception in ASGI application" (I'm using the Massed Compute script)

SECourses

it is because fastapi broken globally all gradio apps. either reinstall or activate venv and pip install fastapi==0.111.0 - i just fixed requirements on the repo

Mike

It works, thanks

100Sachen80

Hi, download link points to: "Expired URL"

SECourses

fixed the link. if such thing happens always check very bottom attachments links

Steve

Does this only work with video? Or can it take audio and animate an image realistically to fit the words?

SECourses

for video it is weak. you can extract frames and upscale as batch but it is not made for video frame system

ArO

Receiving this error. I know its Cuda problem, so i downloaded 8.9.7, but i have problem adding to environment as you did on video. My envir look different. https://i.ibb.co/JQ3NBcb/1.jpg Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 1 Starting Human Live Portrait... [18:15:17] Load appearance_feature_extractor from live_portrait_wrapper.py:46 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\a ppearance_feature_extractor.pth done. [18:15:18] Load motion_extractor from live_portrait_wrapper.py:49 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\m otion_extractor.pth done. [18:15:20] Load warping_module from live_portrait_wrapper.py:52 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\w arping_module.pth done. [18:15:22] Load spade_generator from live_portrait_wrapper.py:55 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\s pade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:59 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\retargeting_m odels\stitching_retargeting_module.pth done. 2024-10-10 18:15:22.2649472 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" *************** EP Error *************** EP Error C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. when using ['CUDAExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** 2024-10-10 18:15:22.3103646 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in __init__ self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\app.py", line 64, in gradio_pipeline = GradioPipeline( File "D:\AI\Live_Portrait_V6\LivePortrait\src\gradio_pipeline.py", line 42, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\live_portrait_pipeline.py", line 53, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\cropper.py", line 63, in __init__ self.face_analysis_wrapper = FaceAnalysisDIY( File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\face_analysis_diy.py", line 37, in __init__ super().__init__(name=name, root=root, allowed_modules=allowed_modules, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\app\face_analysis.py", line 33, in __init__ model = model_zoo.get_model(onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 96, in get_model model = router.get_model(providers=providers, provider_options=provider_options) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 40, in get_model session = PickableInferenceSession(self.onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 25, in __init__ super().__init__(model_path, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 432, in __init__ raise fallback_error from e File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 427, in __init__ self._create_inference_session(self._fallback_providers, None) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. Press any key to continue . . .

SECourses

yes click edit path and make cudnn 8.9.7 top, also make cuda 12.4 top as shown in video

SECourses

txt file deleted cant see. also did you make cuda 12.4 default in all fields? and did you reinstall after cuda 12.4 update?

ArO

I did full reinstall after cuda installed. https://i.ibb.co/3kfygcX/Screenshot-2024-10-11-145031.png https://i.ibb.co/5sD8w0Y/Screenshot-2024-10-11-145058.png https://i.ibb.co/NYkqDNS/Screenshot-2024-10-11-150031.png Please select an option: 1. Human Live Portrait 2. Animal Live Portrait Enter your choice (1 or 2): 1 Starting Human Live Portrait... [15:01:01] Load appearance_feature_extractor from live_portrait_wrapper.py:46 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\a ppearance_feature_extractor.pth done. [15:01:03] Load motion_extractor from live_portrait_wrapper.py:49 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\m otion_extractor.pth done. [15:01:04] Load warping_module from live_portrait_wrapper.py:52 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\w arping_module.pth done. [15:01:06] Load spade_generator from live_portrait_wrapper.py:55 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\base_models\s pade_generator.pth done. Load stitching_retargeting_module from live_portrait_wrapper.py:59 D:\AI\Live_Portrait_V6\LivePortrait\pretrained_weights\liveportrait\retargeting_m odels\stitching_retargeting_module.pth done. 2024-10-11 15:01:06.2238791 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" *************** EP Error *************** EP Error C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. when using ['CUDAExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** 2024-10-11 15:01:06.2806308 [E:onnxruntime:Default, provider_bridge_ort.cc:1744 onnxruntime::TryGetProviderInfo_CUDA] C:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1426 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll" Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 419, in __init__ self._create_inference_session(providers, provider_options, disabled_optimizers) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "D:\AI\Live_Portrait_V6\LivePortrait\app.py", line 64, in gradio_pipeline = GradioPipeline( File "D:\AI\Live_Portrait_V6\LivePortrait\src\gradio_pipeline.py", line 42, in __init__ super().__init__(inference_cfg, crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\live_portrait_pipeline.py", line 53, in __init__ self.cropper: Cropper = Cropper(crop_cfg=crop_cfg) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\cropper.py", line 63, in __init__ self.face_analysis_wrapper = FaceAnalysisDIY( File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\face_analysis_diy.py", line 37, in __init__ super().__init__(name=name, root=root, allowed_modules=allowed_modules, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\app\face_analysis.py", line 33, in __init__ model = model_zoo.get_model(onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 96, in get_model model = router.get_model(providers=providers, provider_options=provider_options) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 40, in get_model session = PickableInferenceSession(self.onnx_file, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\src\utils\dependencies\insightface\model_zoo\model_zoo.py", line 25, in __init__ super().__init__(model_path, **kwargs) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 432, in __init__ raise fallback_error from e File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 427, in __init__ self._create_inference_session(self._fallback_providers, None) File "D:\AI\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\onnxruntime\capi\onnxruntime_inference_collection.py", line 483, in _create_inference_session sess.initialize_session(providers, provider_options, disabled_optimizers) RuntimeError: C:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:866 onnxruntime::python::CreateExecutionProviderInstance CUDA_PATH is set but CUDA wasnt able to be loaded. Please install the correct version of CUDA andcuDNN as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported. Press any key to continue . . .

SECourses

i am making a fresh install now to verify

ArO

And?

ArO

I deleted everything and, following the step-by-step instructions from your articles, I reinstalled from scratch. Still the same error persists. Everything is identical, and the paths in PATH are correct. I'm giving up; it doesn't make sense. I found another version of the same program, LivePortrait6, and it works without any issues, so I have no idea what's wrong with this one. Install log: https://justpaste.it/fj7il Startup log: https://justpaste.it/gjx3k ENV scr: https://i.ibb.co/KK0CYRc/Screenshot-2024-10-12-144512.png I give up!

SECourses

you have install error. very likely you are missing accurate c++ tools D:\Live_Portrait_V6\LivePortrait\venv\lib\site-packages\torch\utils\cpp_extension.py:380: UserWarning: Error checking compiler version for cl: [WinError 2] The system cannot find the file specified warnings.warn(f'Error checking compiler version for {compiler}: {error}') building 'MultiScaleDeformableAttention' extension creating D:\Live_Portrait_V6\LivePortrait\src\utils\dependencies\XPose\models\UniPose\ops\build\temp.win-amd64-cpython-310

ArO

I just replaced all files from capi folder from FaceFusion_6 capi folder and works now.

reaper557

Very cool! I finally tried your app after following along with your 'install ai tools' video and it works like a charm.

SECourses

awesome thanks a lot for comment