Play.ht will want to have as much information as possible about their users.
No need for a bunch of onerous kyc or anything IMO
I think that a few years from now this tech is going to be ubiquitous, real time, and work on a mobile device. Trying to slam the lid shut on Pandora's Box probably isn't going to work.. the best thing at this point would be for the word to get out to everyone that voices can now be doctored the same way photos can
We're in for some really strange times.
> "Hi Mom, I need some help. Some guys hit me over the head and put me in a van, and they're saying they'll kill me if you don't wire money to this bank account."
top class.
PS on the downvote: sorry if I did hurt someone's feelings, but it's the truth
It’s very possible that some other voice cloning software will be the undoing of the fabric of society, not this particular website.
To me your reaction is like dismissing version 1 of the iPhone as a nothingburger because it’s battery isn’t good enough to be practical at launch.
Either way an unconvincing audio file is an unconvincing audio file regardless of what other files may become possible in the future through any number of various platforms and software implementations.
In the same vein, it is prudent not to mix up the factual current state of things with possible futures.
I don’t see the purpose of panicking right now. Are you using this anxiety as motivation to design better audio fingerprinting solutions? Identifying bad actors and vulnerable groups? Educating people on how to avoid being manipulated by fake audio?
What does posting “I am scared of the future” online accomplish?
I'm not sure she would have spotted the scam if it had sounded right.
> I recommend you immediately add identity verification (state-issued identification verification)
and
> The genie is already out of the bottle. The degree of effort to put this together is low enough that it will be replicated around the world.
are thoughts that end up in the same post?
If the genie is out of the bottle, it’s your proposed solution that everybody that runs a model like this implements bank-style KYC?
What do you propose should happen when this sort of software becomes freely available for everyone? When (not if) that happens, what will your suggestion have accomplished?
The solution to scams is to educate people on scams, as quickly as you can do so in the changing environment, by publishing information about what's possible with the latest technology. The solution is not to require onerous identity verification for every software product that could be used by scammers, because they'll just move to the next product that doesn't require it, or they'll simply provide fraudulent documents. Or you'll get "resellers" who provide their own fraudulent KYC documents and then sell access to their account to other criminals on the black market, making it even more difficult to monitor for abuse.
If you want a startup offering such tools to protect people from scams, they can do it by collecting data on what the tools are used for - it should be pretty obvious based on transcripts who is using it to scam people.
https://www.businessinsider.com/couple-canada-reportedly-los...
https://www.aarp.org/podcasts/the-perfect-scam/
They have quite a few stories about "virtual kidnappings" and interview the people involved -- it's quite interesting, and has given me a lot of insight into how typical it would be for people to hear panic and react with panic...precisely how these scams are intended to go.
People here are talking about taking this service offline but I think everyone needs to be thinking about countermeasures, working on those services next. The genie is already out of the bottle. The degree of effort to put this together is low enough that it will be replicated around the world.