AI: Characters Doing Magic Spells in ALIVE - Function Calling (Patreon)

Many that use Alive's AI feature probably don't know that it's been possible for the AI characters to trigger anything on their own since October of last year, by setting up some commands/rules for them. It's not very easy to use but it's a very powerful system that allows using AI in very cool new ways. Anything that's triggerable in Virt-A-Mate, the AI can trigger on its own, including everything that's possible through the ALIVE UI (with the help of the Triggers app). In the video, the AI triggered the music app playlist and the music stop features from the Alive UI. The background color is changed using an alive trigger too, the one used for changing the background color from Settings app. 

The assistant layer that Alive uses for the rules is based on javascript, so it's possible also to get the AI to trigger anything that's triggerable through javascript, which is kind of anything that you can imagine. People can even connect it to their home automation system if they want to have the AI turn into a poltergeist. Or to teledidonics through the buttplug.io interface. 

Before you get too excited, this is not a casual gameplay oriented feature, it's very much a hardcore hobbyist oriented feature. It requires adding a few line of code in a file to set your commands and what they do. I'll try to include in Alive v71 the spells/commands from this video as examples. I had very little time and support to work on this kind of stuff so it's something I put together as fast as possible back in October and didn't touch it since. So it's a bit rough around the edges and not very intuitive, definitely not professional, I had to improvise a lot. 

There's a guide with more info about these systems here for people that want more technical info about it and want to try to play with it.

HOW IT WORKS

The feature showcased in the video is a complementary feature to ALIVE's User commands. With the latter, you could set rules for things to happen when you say or write some specific phrases. Those are more like classic voice recognition commands that people tried to do in the past in VAM, but more advanced and flexible since they allow things like wildcards. On the AI side of things, this feature allows setting rules for things to happen when the AI says something specific.

To give the AI the power of using these commands, the AI needs to know about them and what they do. They need to be described either in the character info or in the Custom intro section in Settings. This is for example what my character in the video knew:

Depending on how smart the model is, it will use the commands as expected and sometimes even on its own, as an emergent way for the AI to interact with you. The model in the video was a 7B model: TheBloke/dolphin-2.6-mistral-7B-dpo-GGUF . Most of the times (like 80%) it used the commands as expected, but sometimes it would use them in unintended ways or ways that don't work due to limitations of my code.

EMERGENT BEHAVIOR

This was one example when the AI used a command on its own in an emergent way. I was gossiping with the AI the vamhub Moderation Team and the AI decided on its own to change the VAM background color to black, to fit the atmosphere of such a gloomy subject:

The bad color format (00000 instead of 000000) was a bug from Alive that I fixed later in v71. It's a cleanup thing I did to try to prevent or contain the smaller AI models from getting stuck in a loops of repeating characters. 

FOR CASUAL USE

I'll try to figure something out to build that is easy, powerful and content-rich for everyone to take advantage of some of these very cool and futuristic features without any DIY work. I'm not sure yet what it will be. Suggestions are welcomed!