WIP: VaM local AI situational awareness experiment (Patreon)
Content
Some quick experiments I made with local AI & VaM:
- character expressions based on dialogue. With the first response, the message is being detected as having a negative sentiment so the character frowns. The second response is more positive and the character smiles
- situational awareness driven by code logic that acts as sensors. AI is not that smart yet to know what's going in VaM. But it's possible to get it closer to that with custom code that feeds & alters the information the AI knows about the current context. In the example the AI knows in which room of the Alive Home scene it is and also the time.
The first experiment is meant to simulate internal stimulus: the AI modifying things in the 3d world based on AI "thoughts" & emotional states. The second simulates external stimulus: the AI "thoughts" & emotional states get influenced by what's going on in the 3d world. These together I think are the bare minimum needed to connect language model AI to 3d spaces, or games in general.
Files
Previews only