I suppose if you could make agents all sound the same they would be interchangeable, and companies always love that. It’s Anjali or Ligaya or Dolores but now they all sound like “Becky”?
I really believe that we are entering a "golden age" of fraud. It will be crazy.
I have a friend who has a faint, scratchy voice because his throat is riddled with benign growths that a surgeon has to dig out of him every few years. Eventually he will probably lose his voice. Maybe?
But the prototypical legitimate use case (which we needn't be excited about), is a voice over artist leasing their timbre instead of their time so that new text can be made to sound like them without their being actively involved. If it were to become mature (which doesn't seem close, from this example), it would be a big step up from existing phone tree voice assemblage and would open the doors for dubbing, animation voiceover, harmonization, and ADR in commercial sound and film.
Gender masking or general anonymization aren't really served by this, as you don't need to adopt a specific target timbre to deliver on those. There are other techniques that work perfectly well for those uses, some that have already been around for ages.
I know of one: transgender people often would like to alter the timbre of their voice and spend a lot of time training their voice. At least for online scenarios, this can just do it.
But other than that AI voice altering research seems like it benefits mostly scammers? I’m just wondering what they tell themselves they’re doing. I didn’t see this in the paper.