Home Creators Posts Import Register Favorites Logout
haven't archived this post yet. have a subscription? use the importer!

Content

Some quick experiments I made with local AI & VaM:
- character expressions based on dialogue. With the first response, the message is being detected as having a negative sentiment so the character frowns. The second response is more positive and the character smiles
- situational awareness driven by code logic that acts as sensors. AI is not that smart yet to know what's going in VaM. But it's possible to get it closer to that with custom code that feeds & alters the information the AI knows about the current context. In the example the AI knows in which room of the Alive Home scene it is and also the time.

The first experiment is meant to simulate internal stimulus: the AI modifying things in the 3d world based on AI "thoughts" & emotional states. The second simulates external stimulus: the AI "thoughts" & emotional states get influenced by what's going on in the 3d world. These together I think are the bare minimum needed to connect language model AI to 3d spaces, or games in general.

Files

Previews only

virtamate chat experiment

experimenting with expression driven by AI dialogue & situation awareness for 3d characters as a Virt-A-Mate mod. Local AI running in oobabooga

Comments

Anonymous

That said, I imagine the compute power of giving an AI a simulated nervous system with sight, hearing, smell, taste, and touch, and would be immense given current hardware/software capabilities. Not to mention, very complex. What you've done here is very intriguing. It's like we're watching AI "wake up" in very slow motion. Can't wait to see more!