Maybe for side quests but even that would be a debug hell.
Re:GPT-4 Details Leaked
by hovering_nox on Tuesday July 11, 2023 @03:47AM
(#36677723)
There is a mod for Skyrim where someone piped together multiple AI models. It goes like this: You speak into your microphone and ask a NPC something. This gets transcribed (voice to text) by Whisper AI. This transcript gets send to eg. GPT-4 with a pre-prompt engineered to give background, current information and the "personality" for the NPC you are talking to. The output of this gets piped back to a Text-to-Speech solution like eleven-labs with the original NPC voice.
A game like Fallout/Elder Scrolls with AI generated NPCs and questlines would be so sick too if executed well.