Home Creators Posts Import Register Favorites Logout

Downloads

Content

Video - https://youtu.be/dgts0wG3kh0

Overview

MiniMax H3 is here, and despite the HUGE size, Comfy says it will even run happily on an Nvidia 3060 - https://blog.comfy.org/p/minimax-h3-day-0-support-in-comfyui!

MiniMax H3 is a general-purpose, omni-modal generative system. It supports unified understanding of multimodal contexts composed of text, images, video, and audio, and can generate video with native stereo audio at resolutions up to 2K and durations of up to 15 seconds. Note that the ComfyUI native generation goes up to FULL HD (1920), so alternative upscaling options (e.g. image resize) are needed to go to 2K.

Thanks to its task-generalisation-oriented system design, H3 already possesses broad multimodal context understanding and generation capabilities at the pre-training stage, enabling outstanding performance in following complex multimodal instructions.

H3 supports the following input and output specifications:

Category Specification Output duration 4–15 seconds

Output aspect ratio: Supports a wide range of aspect ratios, including but not limited to 21:9, 16:9, 4:3, 1:1, 3:4, and 9:16

Output resolution: Supports various resolution dimensions. The shorter side is set to 768 pixels by default.

Output frame rate: 24 FPS

Output audio: 32 kHz stereo

Supported dialogue languages: Stable support for 11 languages - Arabic, Chinese, English, French, German, Italian, Japanese, Korean, Portuguese, Russian, and Spanish. Additional languages are also supported to varying degrees

Because I like testing all the things without having to load up a whole bunch of different workflows, I've created a single, combined flow which features:

Text-to-Video

First Frame / Last Frame

Custom Audio Inputs

Custom Video + audio

and more!

MiniMax-H3 features a non-FOSS licence, so be sure to check it out - https://huggingface.co/MiniMaxAI/MiniMax-H3/raw/main/LICENSE

There is also a Q&A about the licence, given that it is so complex: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/QA-about-License.md

For most of the world outside if China, it means filling in a form the get a license from them. I did just that, and the email came through almost instantly.

Workflow Information

To open the workflow, either drag the .json file into Comfyu, or use File -> Open (ctrl-o).

Model Downloads

There are a wide variety of model sizes available, but I've been using the INT8 / NVFP4 versions because they are smaller (and faster)!

Links are provided in-workflow:

Custom Nodes

Only a few custom nodes are required:

Model Loaders

There are 2 MiniMax H3 models - one for References (REF) and one for First/Last frame (FL):

Be sure to select the correct unet_name for each group! The fl2va model should be the one selected in the "Load Model - FL" group:

With the ref2va model being selected in the "Load Model - Ref" group:

Note: I'm using the pruned_int8 versions, but you can use whichever model is best for you!

I found Sage Attention made things a lot faster, but if you don't have that (and Triton) installed, then switch the "Patch Sage Attention KJ" node value of "sage_attention" to disabled and "allow_compile" to false:

You can use either model at the flick of a switch:

First/Last model enabled example:

Ref model enabled example:

Note how the model loader group you aren't using turns purple, which means it is bypassed.

You may wish to start off at 0.2 megapixel resolution to start with to see how things go (this is quite fast and a great way to test prompts):

Video rendering can take a while depending on the length & resolution you use, as well as your own computer hardware.

Prompting

Only a positive prompt is required:

The Qwen3-VL model has decent understanding, so prompts can be quite complex!

Input Options

There are a lot of input options!

Click the switch to toggle between "yes" and "no". If a group is set to "yes" then it will be used. So say, for example, if you only wanted to use a Last Frame (assuming you're using the FL model), then you would only say "yes" to the Last Frame group:

You'll see the nodes in the group(s) you said "yes" to will no longer be coloured purple (aka bypassed). Don't forget to pick the image you want to use as well!

You can change the image size using a number of methods:

Note that the Ref model will scale images anyway, but with First/Last you may wish to change images to match your video resolution.

First and Last Frame notes

If using the FL model then IMG_0 is the First Frame and IMG_1 is the Last Frame. The other images and audio will have no effect. When using the FL model, if the First Frame is enabled, it will always be first, regardless of your prompt - same goes for the Last Frame.

Ref model notes

When using the Ref model then all inputs can be used - the 4 images, video (and audio) & any custom audio too - plus the images can be displayed in any order (you won't always get the First Frame (IMG_0) first)!

Your prompt can make all the difference too. Say for example, like above, you only have IMG_1 enabled.

If you use <Picture 0> in your prompt, you likely won't get the likeness:

However, using <Picture 1> in your prompt instead stands a much better chance (even though the prompt is for a woman!):

You can also increase the number of inputs (by adding more image/video/audio loaders along with set nodes & attaching their get nodes in the engine area) - but there are some limits, as detailed in the note provided:

Inputs

You can use more images if you like, but I've wired up 4 to start with:

There are also 2 x custom video inputs, and 2 x custom audio options. I found on occasion that certain videos without sound could confuse the VHS nodes - but the addition of the Any Switch seemed to prevent such errors. If you do get an error saying that you video doesn't have sound (and so the Video node doesn't want to play ball), simply disconnect the audio output noodle.

The voice cloning works great with 5 second audio clips, but may also work fine with shorter durations. Let me know if you get away with much shorter extracts!

Sampler

You likely won't want to change anything in the sampler other than the random seed:

Despite what Comfy says, I've found the simple scheduler just fine, but experiment away with alternative options should you wish.

Output

The output selection uses the Video Combine node, so you can adjust the various options there, such as for generating PNG or GIF outputs:

Frame Interpolation

Should you wish to go up to 48fps (or more), then enable the Frame Interpolation group and download your choice of RIFE/FILM model:

Change the value in the FPS Multiplier for even more FPS goodness.

The Engine

If you do want to play with the engine, it is up and outside of the usual map:

The MiniMax H3 Reference to Video node can take a few more inputs - so if you want more than 4 images, for example, then connect away!

Enjoy! :)

Files

Comments

Tim Jones

This one is amazing. I do have one question that is related to Image to Video. I have enabled three image inputs and loaded the character sheets from my "actors". Each sheet has 5 face angles with expressions, 3 standing front facing with different outfits and separate 3/4 left and right side with a full rear shot. These are placed as IMG_0 through IMG_2. When the video is generated, the first part is correct with the characters placed and interacting (drinking coffee and chatting based on a simple script) properly, however, the last few frames are quick cuts displaying the character sheets. Is there a node or setting that would keep the character sheets from showing up and just generate the video?

Jonas Rogander

Can you put a video as reference so it makes that video longer? Like if I generate a 5sec video and want it to get longer. Is that possible with this workflow?

Mike Bloomberg

Using model in ref mode I added a reference video along with images for character replacement. I prompted the model to replace the characters in the video with the ones in the reference images. For some reason the resulting video is the reference video and then a random shot of a reference image character for the last second. Any ideas as to what could cause this?

Bob Doyle Media

I'm clearly missing something obvious. I'm not understanding how to use the reference images properly. I changed the model to the reference model, but I'm not sure what else I have to change in the interface, because it's not behaving as I expect when using reference images. the first couple of frames are the actual first image and then it clicks over to following the prompt.

Sir Sausage

If i had an audio, do i need to link to something or leave it as it is?

Tim Jones

It appears that using the REF path - which created perfectly from my 3 reference images - doesn't get dialog correct . It was adding gibberish beyond what I specified. The dialog that I directed was connect, but in between the two characters' speaking, there was extra garbage sound from the female character (made up words?). Otherwise, the resulting video was perfect. To fix this, I cut the First and Last frames, added those as IMG_0 and IMG_1 after converting to the FL path while passing in the same prompt - et voilà! Perfect results.

john doe

Been following you for a long time and attribute alot of my progress to what you have taught me. Would love for you to take a look at my new music video created with minimax. I truly believe it will become the benchmark for what can be done. thanks for all you do: https://www.youtube.com/watch?v=1Gfahmo7Hlc

Jinz

I've been getting OOM errors frequently, but this workflow is able to provide better outputs (especially with character consistency). I've reduced to the 0.2 megapixel size and using a 3090. Using an image with video for reference audio.

Dave

I cannot get a simple video of a character (given in image 1) to speak the audio from a given audio track (audio 1). The result is jibberish and a changed background from the reference image. It works just fine in the ComfyUI template. I spent 20 minutes with ChatGPT to try fix the issue and in the end ChatGPT's recommendation? Use the template workflow instead.

Cyrus Mordigan

Hey, are you doing a video for Qwen3 tts?