Home
Creators
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register Favorites Keys Review DMs Logout
Community
Telegram ThePornDude
Home Creators Posts Import Register Favorites Logout

ComfyUI With Mimic Motion Change Video Background (Patreon)

Published:
2024-09-02 15:23:46
Imported:
2026-06

Content

Video Tutorial : https://youtu.be/kBUdLRWFmI8

Things you need to know:MimicMotion Blog : https://tencent.github.io/MimicMotion/ 

Github : https://github.com/Tencent/MimicMotion 

MimicMotion ComfyUI Custom Node: https://github.com/kijai/ComfyUI-MimicMotionWrapper

Workflow for Patreon Supporters : https://www.patreon.com/posts/111263092/

 

Files

Comments

Nenad Kuzmanovic

2024-09-05 03:24:40.354 - execution.py:386 - ERROR - !!! Exception during processing !!! need at least one array to stack 2024-09-05 03:24:40.356 - execution.py:387 - ERROR - Traceback (most recent call last): File "C:\Comfy_UI_V2\ComfyUI\execution.py", line 317, in execute output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "C:\Comfy_UI_V2\ComfyUI\execution.py", line 192, in get_output_data return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb) File "C:\Comfy_UI_V2\ComfyUI\execution.py", line 169, in _map_node_over_list process_inputs(input_dict, i) File "C:\Comfy_UI_V2\ComfyUI\execution.py", line 158, in process_inputs results.append(getattr(obj, func)(**inputs)) File "C:\Comfy_UI_V2\ComfyUI\custom_nodes\ComfyUI-MimicMotionWrapper\nodes.py", line 451, in process detected_bodies = np.stack( File "C:\Comfy_UI_V2\ComfyUI\venv\lib\site-packages\numpy\core\shape_base.py", line 445, in stack raise ValueError('need at least one array to stack') ValueError: need at least one array to stack 2024-09-05 03:24:40.358 - main.py:138 - INFO - Prompt executed in 32.83 seconds I've tried everything, update, create nodes from scratch etc..

Nenad Kuzmanovic

The problem was with outdated Diffusers. Everything is working, but my character is pretty destroyed and unrecognizable after Mimicmotion. Here is the clip: https://drive.google.com/file/d/101VUN9canxPNbFG5yVxeISrZW5Qeh_WV/view?usp=sharing Can you tell me what i am doing wrong? I didn't change anything, except raising steps from 20 to 30, cause is was even worse with 20 steps. I have one more question: how can I replace the background with a video that has a different aspect ratio? For example, the background video is 16:9 and the character Mimicmotion is 1:2. I tried to do it myself with the compositing nodes but it didn't work. Thanks in advance, sorry if I'm boring with questions.

John C

In the AnimateDiff Refiner workflow section, in Load Advanced ControlNet Models. I could not find where to download "Animate_controlnet_checkpoint.ckpt". My guess this is a rename? But I'm not sure which model or ckpt to download to get this part to work.

Eugene Feder

Hello) In the AnimateDiff Refiner workflow section an error pops up... 'VAE' object has no attribute 'vae_dtype'..is there anything you can do?