[Workflow] Kolors_V Try-On [Advance] [Ver.20241101] (Patreon)

Tutorial Video: https://youtu.be/tdbntcnE79A

This workflow are going to continue with update, the next version, I will be try to enhance the Try-On success rate. I think that is all we need to focus for V Try On workflow.

Below are list of models and custom node that need for running Kolors Diffusion:

Here's the model your need : 

https://huggingface.co/spaces/Kwai-Kolors/Kolors-Virtual-Try-On

https://github.com/Kwai-Kolors/Kolors/blob/master/imgs/Kolors_paper.pdf

https://huggingface.co/Kwai-Kolors/Kolors

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus

For Custom Node:

I built the workflow base on this custom node

https://github.com/MinusZoneAI/ComfyUI-Kolors-MZ

Implementation of Kolors on ComfyUI

UNET model download

The unet model is placed in the models/unet/ folder

Model homepage: https://huggingface.co/Kwai-Kolors/Kolors

Download link: https://huggingface.co/Kwai-Kolors/Kolors/resolve/main/unet/diffusion_pytorch_model.fp16.safetensors

ChatGLM3 model download

The chatglm3 is placed in the models/LLM/ folder

Model homepage: https://huggingface.co/Kijai/ChatGLM3-safetensors

Download link: https://huggingface.co/Kijai/ChatGLM3-safetensors/resolve/main/chatglm3-fp16.safetensors

IPAdapter implementation is recommended to use cubiq/ComfyUI_IPAdapter_plus

The faceid related nodes have been supported in it, and the IPAdapter implementation needs to update ComfyUI_IPAdapter_plus to the latest version

Official IP-Adapter-Plus model download link

Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/ip_adapter_plus_general.bin Download to models/ipadapter/

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-Plus/resolve/main/image_encoder/pytorch_model.bin Download to models/clip_vision/

Official Kolors-IP-Adapter-FaceID-Plus model download link

Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/ipa-faceid-plus.bin Download to models/ipadapter/

https://huggingface.co/Kwai-Kolors/Kolors-IP-Adapter-FaceID-Plus/resolve/main/clip-vit-large-patch14-336/pytorch_model.bin Download to models/clip_vision/

https://huggingface.co/MonsterMMORPG/tools/resolve/main/antelopev2.zip Download and unzip to models/insightface/models/antelopev2/*.onnx

Official ControlNet model download link

Model homepage(Depth): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Depth

Model homepage(Canny): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Canny

Model homepage(Pose): https://huggingface.co/Kwai-Kolors/Kolors-ControlNet-Pose

Kolors-Inpainting model download link

Model homepage: https://huggingface.co/Kwai-Kolors/Kolors-Inpainting

https://huggingface.co/Kwai-Kolors/Kolors-Inpainting/resolve/main/unet/diffusion_pytorch_model.safetensors Download to models/unet/