Advanced AI Projection Mapping Workflow - Project Files (Patreon)
Downloads
Content
Generate projection mapping content for any object. Using comfyUI with some mask segmentation and controlnets, you can auto-generate unlimited content with this workflow. You just need a mask of your projection surface and some style references.
IG: https://www.instagram.com/reflekkt_/
Overview of the Workflow:
Capture a photo from the projector's perspective.
Make a mask of your projection surface from that photo. Use different colors to assign different style references to these areas.
Select style references for your content.
Use comfyUI to generate content. (Set auto-queue to iterate through your style reference folder).
Interpolate the content with Flowframes and finalize the mapping in TouchDesigner or any other mapping software.
Links:
comfyUI installation: https://www.youtube.com/watch?v=E_D7y0YjE88&t=40s&ab_channel=MDMZ
Absolute Reality 1.8.1 model: https://civitai.com/models/81458?modelVersionId=132760
lcm-lora-sd15 https://huggingface.co/latent-consistency/lcm-lora-sdv1-5/tree/main
Flowframes Interpolation: https://nmkd.itch.io/flowframes
Pixel Upscaler Model: https://civitai.com/models/147817/realesrganx4plus