Home
Creators
Search Recent Random
Posts
Search DMs Popular Hash Lookup Tags Random
Importer
Import FAQ
Register Favorites Keys Review DMs Logout
Community
Telegram ThePornDude
Home Creators Posts Import Register Favorites Logout

WIP: Character vision (Patreon)

Published:
2023-08-25 19:34:44
Imported:
2026-06
haven't archived this post yet. have a subscription? use the importer!

Content

This is a  quick video I made showcasing a pretty cool experimental feature I built: the ability for AI characters to see. To not be completely blind would probably be a bit more accurate. It works via Automatic1111's API so it doesn't require installing anything new for people that tried the images AI feature in Alive already.

Files

Previews only

WIP: character chat AI vision in Alive

first experiment with character vision in Alive & quick integration in offline AI chat

Comments

Wade Watts

Even though it's a video, I see it appears to describe a frame at a time like a picture. This looks fascinating with so many possibilities. I wonder if you can feed it a live cam feed. Give it the ability to see through the cam and describe what it sees on a still frame that automatically captures/pauses every 20-45 seconds or so. Then let her loose on Omegle/Chaturbate/Twitch and see how it interprets the visuals. Cool experiment if possible.

SPQRAeternum
>>116077635

Yeah, it's a lot of computation, it takes lots of seconds to react to a single frame. It reacts to whatever it's in front of the character head. It captures an image of what it sees, then the AI processes it and responds. So it can react to anything that you can show it in VAM, or the vam scene itself. Automating replies, having it just go instead of you triggering it, is possible and not hard. I might do what you said like a special command, have a play/stop feature, and it will just keep reacting. But it will have a 5-30s delay likely depending on the machine and setup. For liveaction stuff it might be too much of a delay for it to be cool. But it might work still. We'll definitely find out

Saint66

Amazing! Which Ooba model are you using for this?

Dakoto

Creating a small museum of our own art and then expose it to a person in VAM after hehe !

E.Skimp

I'm now looking forward having a partner who is patiently watching and commenting all my vacation slides.