Home Creators Posts Import Register Favorites Logout

Content

How do you guys feel with me using AI for NPC Banter? While I decided to be against it in terms of a Laura Bailey version of SDA (if you aren't aware, you can read this reddit thread I made: https://www.reddit.com/r/skyrimmods/comments/10u1joy/sda_laura_bailey_ai_revoice/)  

However, I still am open to using AI in other ways, like for the vanilla characters Serana interacts with. 

Previously, I've had to reuse lines, or where that wasn't possible - splice. This allows me to be more creative in conversations with Lydia for example (an NPC I previously shelved banter with, other than the IFD version) because I wasn't able to write anything creative with reused/spliced lines that wasn't derivative of other follower banter with Lydia (like Inigo).   

The moral issue is still there of consent and me not being sure of the consent of the original VAs, but I guess it's okay or more permissible if other people are doing it? (a good number of mods are out that use Elevenlabs that add lines to vanilla voice types).

Open to thoughts and I'm still on the fence here.

Comments

Noeru

imo, things like that simply won't happen if there's no AI voice because voice actors are very surely not available for mods, things that are not economic and expand the lore of a game in a non personal way. It's different obviously for things like people getting their names red out or lines recorded. But in this case everyone will benefit from it equally and therefor I don't see a problem with it.

Martimius

I'm talking about banter with other (vanilla) NPCs here. Pretty hardline against using AI voices of other NPCs who have original, non-vanilla voice actors.

Kryptonian Eradicator

For what it's worth, I have never been comfortable with AI "art," partially on the whole theft angle (my stuff on DeviantArt is ALL marked with the "no AI permissions," or however it's phrased, label). Of course, it is also based on a sense of artistic sincerity. AI never feels as real, as honest, as the genuine, sentience-produced, article. Of course, having grown up with Lt Cmdr Data and KITT, I'd be reluctant to call what we have right now true AI, but hopefully someday... But, it is the accepted nomenclature and I bow to language's demands. Very interesting question.

Brad C

I'm all for it with vanilla NPCs/voices. I feel like there's a bit less of a moral issue with vanilla NPCs since the AI is likely trained on the vanilla lines so it's content that Bethesda basically already gave permissions to make mods with IMO. To me it's not any different than the thousands of mods re-using vanilla assets for various things such as towns, weapons, armors, etc. since they are all vanilla assets.

Martimius

Thank you for the feedback! Glad to hear you're for it!

Natalie Lane Sowers

I don't know enough about the legalities to say anything on that but the mods that I have played through with this AI voice thing has been pretty good. Like the Innocence Lost overhaul that allows you to even get Grelod thrown in jail. It was pretty fun to play, frankly. I think the AI could add a lot to SDA if used correctly and has a lot of potential, personally.

Godzilla89

I say you should so long as you maintain it for just vanilla voices. Doing it for Inigo would be a problem but if you fleshed out Frea in the dragonborn dlc or used it to improve ai banter with your follower mods it'd be a million times better then splicing together. Eleventh labs is scarily good at copying voices so if we got a crack ton of Serana banter where you didn't have to splice up pre existing ai lines, that'd save time and flow better. Plus if you make the ai that talk to Serana banter quickly using it, Kerstyn can listen to their tones in it and respond back in a matter that sounds more natural. And lets say you wished that characters like Cicero, Brynjolf, Frea, Aela and all were better fleshed out, you can do those in your free time while Kerstyn can focus on continuing to nail the Serana and Ashe characters

Godzilla89

Oh one more note, splicing vs ai voice, technically are the same thing(original voice used to create more lines without og voice actor) except ai recreates the voice where splicing makes a edited variant that lacks a natural flow

Martimius

Ok! Thank you for your feedback!

Martimius

You have a good point there with the splicing! Thank you for your feedback!

Mathew Xyro

Personally adding more AI lines for the NPCs she interacts with sounds fine to me, there is so many mods that add more lines, I can’t see anything wrong with adding or reusing anything from the game. Your adding content through a mod, I can’t see that being an issue in any way

Cederien

Tough one. I shall ignore the potential moral and copyright problems. (I think though those might be bigger than many believe. Just check out on the fight of artists whose art was used [without permission] to train the various Art AI's cropping up, that the very same artists now suddenly need to compete with.) While Elven Labs voice synthesis is much better than say AVSynth or spliced lines it's still pretty mechanical. It's perfect for the Enterprises computer voice perhaps, but it lacks subtlety and emotion. That might not always a problem and as stated it beats the alternatives, but it's still a pretty significant limitation to keep in mind.

Beyond Ascension

I think it is a wise decision, after all, why not have Serana be all that she can be? I think it's the missing piece with all the new unique mods like Remiel for example....nice bff's by the way!

Ben Dornie

Just to start with a caveat, I don't know what the level of time and effort is using a voice actor compared to AI, so my view below doesn't take this into account. I'd never wish the main character of a mod to be have an AI voice as I'm sure it would lose something significant in the process in terms of emotion, mood, intonation etc. I know this ship has sailed long ago for SDA and am very glad that Kerstyn is aboard! As far as other NPCs are concerned for small amounts of banter, I can see the attractions of using AI for that when compared to seeking out voice actors and then potentially being held up waiting for them to do their stuff. However, I also think the "guild" of ready and willing voice actors that's built up over the years is a wonderful and precious thing and I would hate the thought of that withering and dying over time due to being replaced by AI. I also understand the benefit of using AI where original voice actors have recorded something for a character but are no longer (or not easily) available to record new stuff. Then there's a potential cost issue as well! Perhaps there's a balance to be struck between the voice actors and AI but, ultimately, I'll always be on the voice actor side of the fence because that's supporting real humans doing something that they love and/or trying to earn a living themselves and long may both of those continue! I've probably gone off topic here a bit, but there you are! :)

Aphax

I think that's a great idea. Expanding what you can do with existing NPCs can only improve the mod as a whole.

BlueGunk

ElevenLabs AI (as you mentioned) is doing some great stuff. Dragonborn Voiceover has to be the top mod in this line, right now. As for original actor copyright, three things come to mind: first up the consumer has to buy the use of the voice from ElevenLabs AI. So the actor(s) are paid by ElevenLabs AI. Secondly, they provide their voice knowing it is on the market. Thirdly, SDA is a free mod on the Nexus, so you are not making income from the ElevenLabs AI product. I think that should be OK for copyright questions. It's not like you are doing a Torrent and stealing the stuff! Therefore, I'd be enthusiastic over this potential development!

Drazhan

I'm for it. I'd like to see where it goes and it'd be interesting to see what you could come up with.

Martimius

Thank you for the feedback! In terms of the vanilla voices, there isn't really a way to get in touch with them and expect a response like you could smaller voice actors, so I have less of an issue with just using AI. This is similar to splicing (making new lines from existing lines) and people have been doing that with Skyrim forever. Even I did it with SDA before Kerstyn joined.

Martimius

Thank you for the feedback! Just clarifying these are vanilla voices. I will pay for ElevenLabs but the voices it will be trained on (vanilla) are already provided by the vanilla game. Not an issue though since Bethesda already lets us mod the game and do with the assets as we so please.

HUP06

Yep, as others have stated, for vanilla voices, your paying ElevenLabs for their use. So, all for it, because, for selfish reasons, it’s always awkward when I play mainly with Serana & Lydia together, and their banter is like, zero to none.🙃

Zeroth

Definitely yes. An opinion I have heard elsewhere is that it should be okay for vanilla voices as those lines are skyrim assets and Bethesda has permitted a huge amount of mods to utilise those assets through splicing and synthesis. It follows from that opinion that just because ElevenLabs is higher quality than VASynth, that doesn't change the fact that it is still a permitted use of skyrim assets. All high quality mods are adopting this tech to expand the possibilities for what vanilla NPCs can do and I think this is the future.

vinnyB

i'd rather the npc be unvoiced than ai generated - sounds fake af

Martimius

Oh, trust me. ElevenLabs is hella realistic. That's why I even considered AI in the first place.

Primarch83

I reckon that'd be pretty cool, I do find the Mikael and Serana banter rather entertaining to be honest be nice to see more :)

aaggii19

Elevenlabs is pretty good so using it for new NPC lines would work well enough.

Martimius

Can you also link me where you found out about what Bethesda said about AI? Just so I have future documentation and reference to this.

Martimius

Yep! Excited to make stuff like that as well.

TwistedModding

As long as there wouldn't be a huge discernible difference between the current voice actor and the ai generated lines

Tobogan

A big yes from me too