UniLumos In ComfyUI - New Relighting AI That Makes Your Character Blend Into Any Background (Patreon)

Video : https://youtu.be/5ik6tPs6Yq8

This video dives deep into UniLumos—a new purpose-built AI video relighting framework based on Wan 2.1—and demonstrates how to seamlessly blend foreground characters into new backgrounds with realistic lighting. You’ll see a full walkthrough in ComfyUI, including workflows for UniLumos as a first-pass relighting tool, followed by character refinement using Mocha (Wan 2.1) and Wan 2.2 Animate as second-pass enhancers. We compare results, troubleshoot common issues like clothing color shifts and skin artifacts, and share optimized node setups for high-fidelity AI video generation.

This content is ideal for AI video creators, visual effects hobbyists, indie filmmakers, and ComfyUI users who want to master advanced character relighting and background replacement using open-source models. Whether you're experimenting with AI-assisted post-production or building pipelines for consistent character fidelity across dynamic scenes, this tutorial gives you practical, hands-on strategies using current-generation tools like Wan 2.2 Animate, Mocha, and UniLumos.

Why does this matter? As AI video tools evolve beyond basic text-to-video, the ability to control lighting, preserve character identity, and integrate real footage with synthetic backgrounds becomes critical for professional-quality results. This workflow bridges the gap between experimental AI and usable visual storytelling—helping creators avoid cartoonish outputs, reduce artifacts, and achieve photorealistic consistency without commercial software. In today’s open-source AI landscape, mastering these layered techniques puts you ahead of the curve.

UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedback

https://github.com/alibaba-damo-academy/Lumos-Custom/

https://huggingface.co/Alibaba-DAMO-Academy/UniLumos

https://huggingface.co/Kijai/WanVideo_comfy/tree/main/UniLumos

MoCha

https://www.patreon.com/posts/mocha-new-fine-2-142099129

Wan 2.2 Animate

https://www.patreon.com/posts/wan-2-2-animate-140495285

Attached workflows used in this tutorial: