News for hackers. Stuff that matters.
Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @08:41AM (#37809939)
Who owns your voice? Well, who owns your face? Such things are covered by copyright law. You dont have total control over your face. I can use Fry's face in a parody film or critisism of him as a person. The rules for parody go far.

Deepfakes have already been to the supreme court (hustler v. Falwell). Cutting back on such uses risks cutting into freedom of speech. As with Falwell, the answers involve educating the public so that they can tell fake from real, not giving famous people the ability to blackball every work they feel is too similar to themselves. Lots of people talk like Stephen Fry. He doesnt get to own that accent or mode of speach just because he is the most famous.

Re:Stephen Fry Warns About the Dangers of Voice Clones by JoshTriplett on Sunday October 08, 2023 @08:44AM (#37809955)
> the answers involve educating the public so that they can tell fake from real

At some point, it will become impossible to tell the difference.

Re:Stephen Fry Warns About the Dangers of Voice Clones by 7thaccount on Sunday October 08, 2023 @09:38AM (#37810347)
You mean all those Warhammer 40k lore videos with David Attenborough weren't legit? :)

It is crazy if you need a good example of what Stephen Fry id talking about look at the "Attenborough Lore" channel. I honestly can't tell other than I doubt he'd do voice overs for dozens of 40k videos and the narrator is listed as "AI".

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @10:57AM (#37811045)
Attenborough is an interesting example because he had a real life near-analogue. He had a famous brother, Richard Attenborough (John Hammond in Jurassic Park). Their voices were extremely similar and they of course looked much the same. David is more famous now but back in the 1990s Richard was more recognizable. Who owns the voice? Does it default to the person who is most famous at a given moment? How often to we revisit that? Do the brothers battle it out in court to see which is allowed and which forbidden to do voiceovers using the "Attenborough" voice? And the Olsen sisters... that's a legal quagmire.
Re:Stephen Fry Warns About the Dangers of Voice Clones by makingstuffs on Sunday October 08, 2023 @09:25AM (#37810246)
This is one use case I can see for immutable and distributed public ledgers aka blockchains.

By having a publicly associated wallet which can sign the release/link/buffer of an audio file one would be able to assure legitimacy of the output and the rest of the world can carry on without worrying they are being bamboozled by a deepfake.

However, blockchains have been going so deep down the path of cryptocurrencies and get rich quick schemes that their real use cases are being ignored for random tokens.

The blockchain I envision being used for this purpose I stated above would have no token, it would just be… a blockchain.

I guess you could have the ‘mining/POW’ part take place during the signing of the data and would be done by the signee.

¯\_(ツ)_/¯

Re:Stephen Fry Warns About the Dangers of Voice Clones by axiak on Sunday October 08, 2023 @09:33AM (#37810304)
Genuinely curious -- what does a blockchain provide here that a normal public key signing doesn't?
Re:Stephen Fry Warns About the Dangers of Voice Clones by makingstuffs on Sunday October 08, 2023 @09:38AM (#37810353)
To be honest the main benefit I can see is that the entire DB would be publicly distributed among a large number of independent users which would make the data a lot harder to falsify/hack/corrupt.

However, any system which can achieve the same goal is perfectly valid. This was just my initial thought — probably from my large exposure to blockchains etc

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @10:49AM (#37810965)
A boost to GPU sales.
Re:Stephen Fry Warns About the Dangers of Voice Clones by sneak on Sunday October 08, 2023 @11:49AM (#37811539)
Timestamping and future immutability.
Re:Stephen Fry Warns About the Dangers of Voice Clones by air7 on Sunday October 08, 2023 @09:03AM (#37810086)
I wonder if at that point people will rightfully lose confidence in the authenticity of digital media, or if people are doomed to believe what they see...
Re:Stephen Fry Warns About the Dangers of Voice Clones by kalleboo on Sunday October 08, 2023 @09:08AM (#37810129)
"Digital" doesn't mean anything more.

I live in Japan where Instax instant camera are super popular. Fujifilm makes more money off of making and selling Polaroid-style analog instant film than any single other business. The Impossible Project is cute and fun for hipsters but Instax has been there making film all along.

But they realized that young women today aren't happy how they look, and they want to use Instagram-style beauty filters on themselves, so they started selling Instax Bluetooth printers. They take analog instant film cartridges, but they use an LCD to imprint the photo onto them. So now you get the nostalgia of Polaroid photos, but you can edit your face as much as you want. Is this digital or analog?

Re:Stephen Fry Warns About the Dangers of Voice Clones by bordercases on Sunday October 08, 2023 @09:17AM (#37810190)
The real argument is around degrees of reconstruction in image. Cameras never depict light fully faithfully in the analog world.
Re:Stephen Fry Warns About the Dangers of Voice Clones by kalleboo on Sunday October 08, 2023 @10:05AM (#37810537)
And even in the fully analog days there was plenty of doctoring of photos, it just wasn't as accessible to the common man without the equipment. Famously: https://en.wikipedia.org/wiki/Censorship_of_images_in_the_So...
Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @10:46AM (#37810939)
>> use an LCD to imprint the photo onto them.

It's just blurry digital. The polaroid film is acting as a really lossy medium for the digital information. Look close enough and you will likely still find artifacts of digital photography in the "film" printout.

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @09:05AM (#37810108)
Or famous people can maintain authoritative lists of things they have done and said. Something as simple as Imdb can do much in debunking fakery.
Re:Stephen Fry Warns About the Dangers of Voice Clones by trashtester on Sunday October 08, 2023 @10:10AM (#37810584)
In principle, any digital artifact may be digitally signed, just like web pages are (using CA's).

That way, you can set up a chain of trust, to track where some information is coming from.

This works as long as there is at least a top level signature provider that is uncorrupted. That will be hard in authoritarian societies and maybe even harder in radically polarized societies. Imagine a world where the CPP, DNC and GOP (and others) each controlled their own CA's, and had the ability to present a fake view of reality to their supporters.

Re:Stephen Fry Warns About the Dangers of Voice Clones by dylan604 on Sunday October 08, 2023 @10:36AM (#37810838)
There’s information about me on IMDb that isn’t accurate. Not once ever have I added information about me on IMDb, so where exactly is this authoritative information on IMDb coming from? Requests by me to have information corrected goes no where. IMDb as an authoritative source is pure folly at best
Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @10:43AM (#37810904)
Something as simple as IMBD, not literally IMDB. It is possible for famous people to maintain curated lists of their official work. Presidents especially do this, eventually putting it all into presidential libraries. Or it isn't possible to verify any information online because [reasons] and then our entire society falls apart as nothing online can ever be trusted. We aren't anywhere near that point.
Re:Stephen Fry Warns About the Dangers of Voice Clones by JoshTriplett on Monday October 09, 2023 @12:11AM (#37816863)
> Or famous people can maintain authoritative lists of things they have done and said.

Which can easily omit things they did say but wish they hadn't.

Re:Stephen Fry Warns About the Dangers of Voice Clones by Zetobal on Sunday October 08, 2023 @09:05AM (#37810105)
Why differentiate between digital and offline media do you believe the gro isn't produced digitally?
Re:Stephen Fry Warns About the Dangers of Voice Clones by kzrdude on Sunday October 08, 2023 @08:45AM (#37809962)
Surely, who "owns a face" is not governed by copyright law because a face is not an intentionally created work of art, or anything similar?
Re:Stephen Fry Warns About the Dangers of Voice Clones by TerrifiedMouse on Sunday October 08, 2023 @09:06AM (#37810114)
There is “right of publicity”.

If I’m right, if you take a photo of Leonardo DiCaprio you can’t just use it in a commercial to promote a product without his permission even though you own the copyright of the photo.

Nor can you place an actor in a movie without their permission - they did that with Crispin Glover in Back to the Future 2, he sued the studio and I believe won or the studio settled.

Re:Stephen Fry Warns About the Dangers of Voice Clones by oh_sigh on Sunday October 08, 2023 @09:57AM (#37810473)
What if you found some random joe that looks just like DiCaprio, and paid him $100 to use his likeness in a movie?

That's always been possible, but in the past it would be clear that random Joe isn't a good actor and DiCaprio is. But if the whole thing is CGI anyway, you can make him as good or bad of an actor as you want.

Re:Stephen Fry Warns About the Dangers of Voice Clones by lacrimacida on Sunday October 08, 2023 @10:27AM (#37810757)
You could do that but your cast will not include the name DiCaprio, which is usually a big thing that draws viewership.
Re:Stephen Fry Warns About the Dangers of Voice Clones by trashtester on Sunday October 08, 2023 @11:09AM (#37811147)
One might argue that this would be no different from some artist (or AI) painting a painting in the style of Picasso. As long as you make no attempt at passing it off as an original Picasso, it may be seen as ok, unless we extend intellectual property rights to cover style....

... which we do already do, of course, if the protected item is something like an iPhone.

In both cases, though, if you falsely claim that the actor/phone IS the real thing, then it's clearly forgery.

And, I suppose, if you specifically bake too much of a similarity into it (ie a phone that looks exactly like an iphone, except the logo), one may argue that the likness effectively misleads the same way a forgery would, and that it can be illegal for that reason.

Re:Stephen Fry Warns About the Dangers of Voice Clones by kthejoker2 on Sunday October 08, 2023 @01:08PM (#37812331)
There's a movie Beach Babes from Beyond (not great wouldn't recommend) with Stallone, Swayze, Travolta, and Sheen in it.

Unfortunately that's Jackie, Don, Joey,and Joe instead of Sylvester, Patrick, John, and Martin.

So it's no surefire thing.

Re:Stephen Fry Warns About the Dangers of Voice Clones by TerrifiedMouse on Sunday October 08, 2023 @01:40PM (#37812634)
DiCaprio can probably sue you and win especially if you are deliberately trying to misrepresent his involvement in your project.

As mentioned in my previous post, in Back to the Future 2, the studio hired another actor to play Crispin Glover's role by wearing a mask of his face to look like him. Glover sued and got a nice payout.

This would not have been a problem if they just recasted the role like they did with Claudia Wells (who was replaced by Elisabeth Shue).

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @08:48AM (#37809987)
Tell that to all the celebs that take great efforts to manage and alter their faces. Plastic surgery, exercise and healthy living do alter and "create" faces. Tell that to makeup artists who get payed to paint faces.
Re:Stephen Fry Warns About the Dangers of Voice Clones by paulryanrogers on Sunday October 08, 2023 @08:47AM (#37809982)
Don't actors trademark their likeness because copyright isn't sufficient?
Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @08:50AM (#37809999)
Yes, but trademark has very similar rules to copyright. You can use trademarks in much the same way, such as saying "I hate Coca Cola" (nominative use) or commenting "This security vulnerability brought to you by Windows Vista, the most secure operating system ever" (parody use).
Re:Stephen Fry Warns About the Dangers of Voice Clones by TerrifiedMouse on Sunday October 08, 2023 @09:08AM (#37810123)
The use of their likeness is protected under “right of publicity” if I’m correct.
Re:Stephen Fry Warns About the Dangers of Voice Clones by pbhjpbhj on Sunday October 08, 2023 @09:22AM (#37810221)
Could you cite statute in whatever jurisdiction you're referring to please.
Re:Stephen Fry Warns About the Dangers of Voice Clones by throwaway17_17 on Sunday October 08, 2023 @10:32AM (#37810797)
Not GP, so I don’t know what jurisdiction he was imagining. But, the ‘right to publicity’ is a jurisprudential invention (1958), but it has since been codified in maybe half the states in the US. The case used most frequently in law school is Carson v. Here’s Johnny Portable Toilets, Inc (Carson was found to have right to his catchphrase even without a trademark). For a statute for instance in California Civil Code 3344 (which protects natural living persons’ likeness, voice, photographs, etc.

— Also, none of the above is legal advice.

Re:Stephen Fry Warns About the Dangers of Voice Clones by TerrifiedMouse on Sunday October 08, 2023 @01:28PM (#37812529)
Not a lawyer so don't speak lawyer but if you googled "right of publicity" a few well known cases come up like Vanna White vs Samsung. Vanna White won.

There was also the case of Crispin Glover in Back to the Future 2. Glover also got paid.

Re:Stephen Fry Warns About the Dangers of Voice Clones by throwaway290 on Sunday October 08, 2023 @08:49AM (#37809990)
> Lots of people talk like Stephen Fry

Difference between "someone sounds like Fry" and "have trained a model on his voice and hoped he won't notice". In second version his rights to his voice would be violated

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @08:57AM (#37810049)
So i have to stop doing my Morgan Freeman impersonation at parties? That impersonation has been trained on his movies and speeches.
Re:Stephen Fry Warns About the Dangers of Voice Clones by jl6 on Sunday October 08, 2023 @09:05AM (#37810100)
Doing an impression of someone in private, for fun, with no reasonable possibility of being confused for the original… seems very different to creating voice model outputs with the intent to deceive for financial or political gain.
Re:Stephen Fry Warns About the Dangers of Voice Clones by diggan on Sunday October 08, 2023 @09:43AM (#37810381)
This is something I feel like gets forgotten in this AI debates too often.

It matters not what you could potentially do with a tool but rather what you actually did with the tool and the consequences of what you did. "Fraud" charges already can capture a lot of these things without additional regulating around what models you can legally train in the first place.

Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @11:12AM (#37811181)
The Late Late Show with Craig Ferguson had an on-stage robot voiced by a Morgan Freeman impersonation, a very good one. That show was created to make money and I am sure that a great many people up that late were occasionally fooled by the impersonation. Saturday night live had Tina Fay impersonate Sarah Palin. She did it so well that it even fooled the real Sarah Palin's media team into using images from SNL as images of the actual candidate. Saturday Night live created this fake for profit and, arguably, for political reasons.

https://www.smh.com.au/entertainment/tv-and-radio/fox-news-m...

Re:Stephen Fry Warns About the Dangers of Voice Clones by jl6 on Sunday October 08, 2023 @11:18AM (#37811231)
I imagine the comedic context made it clear there was no intent to deceive.
Re:Stephen Fry Warns About the Dangers of Voice Clones by throwaway290 on Sunday October 08, 2023 @09:41AM (#37810371)
Fun at a party is not running a commercial ML system though.
Re:Stephen Fry Warns About the Dangers of Voice Clones by fzeroracer on Sunday October 08, 2023 @09:31AM (#37810288)
Presumably if you were saying you were Morgan Freeman and acting on behalf of Morgan Freeman and damaging the image of Morgan Freeman, I would imagine you would be asked to stop rather quickly yes.
Re:Stephen Fry Warns About the Dangers of Voice Clones by booleandilemma on Sunday October 08, 2023 @09:24AM (#37810236)
I read your comment in his voice.
Re:Stephen Fry Warns About the Dangers of Voice Clones by tremon on Sunday October 08, 2023 @09:53AM (#37810451)
If your party trick is to call Morgan Freeman's bank and wire a few thousand dollars to the birthday boy^Wperson, yes you should stop doing that.
Re:Stephen Fry Warns About the Dangers of Voice Clones by sandworm101 on Sunday October 08, 2023 @10:35AM (#37810831)
If that works, he really needs to switch to a better bank.
Re:Stephen Fry Warns About the Dangers of Voice Clones by pbhjpbhj on Sunday October 08, 2023 @09:20AM (#37810202)
Natural voices and faces don't seem like copyrightable works. A face resulting from plastic surgery, or a voice you made up for a role; they seem like they could be copyrightable, though also they seem closely analogous too materials you use to create a work, rather than a work in themselves.
Re:Stephen Fry Warns About the Dangers of Voice Clones by rtpg on Sunday October 08, 2023 @09:35AM (#37810325)
> I can use Fry's face in a parody film or critisism of him as a person.

This might feel like nitpicking but given the topic... there are places where there is no notion of 'fair use' like this. There are a whole variety of answers to the question of how much of your identity is yours (and how much is even separable from yourself). One shouldn't take whatever IP regime you're familiar with as the only possible truth.