Re:It’s Game over on Vocal Deepfakes
by techdragon on Wednesday March 22, 2023 @12:31AM
(#35256858)
The problem in increasing order of difficulty are smalltalk, memory, and dirty talk.
1st. A lot of the language models are very bad at pointlessness smalltalk that fills time, they aren’t very good at coming up with related conversational prompts or diversions to continue talking about without being carefully steered and purported by an extra layer of supporting software. The deliberately oversimplified example is that ChatGPT waits for you to say something, and will never just ask how your day was. This isn’t particularly difficult but it’s a case of it’s going to feel a lot like sophisticated NPC smalltalk in a video game for a while I suspect due to the need to drive it from a second system that monitors the conversation and provides the supporting timers to keep nudging along a conversation the way they do in video games
2nd. The majority of the models have limited memory and while we’re seeing clever tricks pop up all the time now about how to feed things back into the models prompts in order to keep it focused on a topic or to bring things back up later, it’s going to take another layer of software that try’s to identify key information and store that in a secondary system and then somehow contextually identify opportunities to mention it in order for us to have a chat bot that can remember what sort of things a person might be into, or more importantly not into and regardless of how good the underlying language model gets at coming up with more words to day, unless the overall system it’s driven by can remember that customer 1 likes feet, customer 2 hates feet, and customer 3 is indifferent to feet… the ability to steer the conversation towards “sex” will be haphazard at best and likely extremely vanilla in a way that I suspect might make the entire thing not worth it, since from what I understand, odd fetishes are a large component of the phone sex business along with lonely people wanting someone to talk to who won’t judge them.
3rd. Despite the prodigious amount of time that must be spent engaging in the kinds of conversations that can best be summed up as “dirty talk”, encompassing the entire gradient from flirtation to describing fornication… not a lot of it is recorded, in any way at all. Well that is to say it’s probably “recorded for security” by phone sex operating companies, but the overwhelming majority of this conversational data is not not archived in any form. It’s not kept as audio past whatever length of time the company decides to keep things, it’s not getting transcribed and it’s definitely not getting marked up and annotated in a way that helps train machine learning models on it. There’s obvious legal and ethical issues involved in obtaining this data, which depend on what form it will be in, actual call recordings are obviously more private than a computer generated transcription pipeline that assigns anonymous identifiers to the operators all random anonymising identifiers to all the callers for each call, even when someone might call multiple times… to the best of my knowledge none of this has ever been seriously researched or studied and I’d imagine even with the “limits off” the best out current language models could do is likely to be heavy on the poetry for flirting and for the “sex” part of “phone sex” it would likely swing between overly clinical and heavy on allusion like a mills and boon romance novel sex scene… I’m going to see what I can coax from ChatGPT to provide some extra evidence. I’ll edit if I’m quick enough.
1st. A lot of the language models are very bad at pointlessness smalltalk that fills time, they aren’t very good at coming up with related conversational prompts or diversions to continue talking about without being carefully steered and purported by an extra layer of supporting software. The deliberately oversimplified example is that ChatGPT waits for you to say something, and will never just ask how your day was. This isn’t particularly difficult but it’s a case of it’s going to feel a lot like sophisticated NPC smalltalk in a video game for a while I suspect due to the need to drive it from a second system that monitors the conversation and provides the supporting timers to keep nudging along a conversation the way they do in video games
2nd. The majority of the models have limited memory and while we’re seeing clever tricks pop up all the time now about how to feed things back into the models prompts in order to keep it focused on a topic or to bring things back up later, it’s going to take another layer of software that try’s to identify key information and store that in a secondary system and then somehow contextually identify opportunities to mention it in order for us to have a chat bot that can remember what sort of things a person might be into, or more importantly not into and regardless of how good the underlying language model gets at coming up with more words to day, unless the overall system it’s driven by can remember that customer 1 likes feet, customer 2 hates feet, and customer 3 is indifferent to feet… the ability to steer the conversation towards “sex” will be haphazard at best and likely extremely vanilla in a way that I suspect might make the entire thing not worth it, since from what I understand, odd fetishes are a large component of the phone sex business along with lonely people wanting someone to talk to who won’t judge them.
3rd. Despite the prodigious amount of time that must be spent engaging in the kinds of conversations that can best be summed up as “dirty talk”, encompassing the entire gradient from flirtation to describing fornication… not a lot of it is recorded, in any way at all. Well that is to say it’s probably “recorded for security” by phone sex operating companies, but the overwhelming majority of this conversational data is not not archived in any form. It’s not kept as audio past whatever length of time the company decides to keep things, it’s not getting transcribed and it’s definitely not getting marked up and annotated in a way that helps train machine learning models on it. There’s obvious legal and ethical issues involved in obtaining this data, which depend on what form it will be in, actual call recordings are obviously more private than a computer generated transcription pipeline that assigns anonymous identifiers to the operators all random anonymising identifiers to all the callers for each call, even when someone might call multiple times… to the best of my knowledge none of this has ever been seriously researched or studied and I’d imagine even with the “limits off” the best out current language models could do is likely to be heavy on the poetry for flirting and for the “sex” part of “phone sex” it would likely swing between overly clinical and heavy on allusion like a mills and boon romance novel sex scene… I’m going to see what I can coax from ChatGPT to provide some extra evidence. I’ll edit if I’m quick enough.