The app has thus not violated end-to-end encryption, nor has that content been exposed to external parties.
Platforms could definitely do more.
You can design a system where false positives are so rare they are insignificant and can be properly handled. The only reason we don't is because we don't think it's that much of a problem.
You can keep the false positive level reasonably low for copies of already known and flagged images. You can't do it for new images.
But flagged known images was the point of Apple's algo, for example. Still everyone just went "forget abuse, my privacy is more important for me". Really at this point techbros deserved any dumb law that lets the government read their chats.
Maybe I actually know something about it.
> But flagged known images was the point of Apple's algo, for example.
You whined at me a little while ago about how all this was about "abuse, not just porn". Yet you're using that to justify a system that, as you describe it, could only find old, known images that have been circulating around the Internet and made it into a database. Meaning images of past abuse that cannot be prevented, by third parties who would not be caught by this.
Pick a threat model, because the measures you defend don't address the threats you claim justify them.
... and if you start talking about "grooming" or "normalization" or other silly bullshit that hypothetically might have a third-order effect, but probably doesn't have any meaningful effect at all in real life, I'm not going to bother to answer it.
> Still everyone just went "forget abuse, my privacy is more important for me".
Everybody's privacy is important to me. Including the privacy of the children whom you want to have grow up in an ever-expanding panopticon. Because this isn't just about stupid bullshit like your embarrassing disease. It's about people ending up in prison. It's about building infrastructure that can trivially and secretly be repurposed to hurt people, including children, in serious, life-changing, and potentially life-ending ways.
The Stasi were not a child-friendly institution.
If you know then you'd agree that with the right setup ML can do this with a very high precision. We're talking about a highly customized system trained exactly for this one purpose not some chatbot.
> You whined at me a little while ago
You're the one whining here buddy-- remember this is about a law about to be forced on you that you find inconvenient ;) I find it suboptimal but in some sense it might be better than nothing.
> this was about "abuse, not just porn".
These are related. If you have this material, you obtained it from somewhere even if you didn't make it yourself. Some police work and it may lead to some dark web exchange marketplace and actual producers.
That said yes, there's difference. The EU law being discussed is probably more fit to counter realtime abuse, compared to Apple's algo for example.
> Because this isn't just about stupid bullshit like your embarrassing disease. It's about people ending up in prison.
I actually agree with these two sentences, but not in the way you probably intended.
> The Stasi were not a child-friendly institution.
I was waiting until Hitler gets invoked in a discussion about using tech to combat and prevent child abuse facilitated by tech, I was not disappointed.
No, it cannot.
Not with a model that you can run on a phone, no matter how specialized it is. Serious ML takes actual compute power (which translates to actual electricity).
Not with a model that you can train on the number of positive examples that are actually available. Current ML is massively hungry for training data.
Not with any model that's out there on people's phones and therefore subject to white-box attack. Adversarial examples are not a solved problem, especially not in the white-box environment.
Probably not with any model. You would need maybe a 0.0000001 false positive rate. That rate falls asymptotically with both model size and training.
> that you find inconvenient ;)
The last refuge of the fanatic is to call anybody who raises inconvenient objections a pedophile.
> I was waiting until Hitler gets invoked in a discussion about using tech to combat and prevent child abuse facilitated by tech, I was not disappointed.
The Stasi did not have anything to do with Hitler, and did not exist at all until after Hitler was dead. They were not part of the Nazi apparatus. Your ignorance of history helps to explain your willingness to give dangerous powers to untrustworthy insitutions, though.
> The last refuge of the fanatic
Between us two there's one with maximalist and absolutist views.
> call anybody who raises inconvenient objections
The actual objections are dealt with. Properly implemented (like Apple's algo) it's not spying, inconvenience and detriment of an individual is a fact of life in any society etc. We just trade personal attacks now.
> a pedophile
Putting words in my mouth.
> The Stasi did not have anything to do with Hitler, and did not exist at all until after Hitler was dead
Thanks for correcting me. So basically Stalin then. Wow, such difference.
You know exactly what you intended to convey with that little smiley, so do I, and so does everybody else.
You're reading too much into this. The smile is there because you called me whining and I did the same to you.
> The right answer here is just to accept that, beyond a certain point, further reducing the amount of circulating child porn
Not porn, don't delude yourself. Actual abuse.
> requires unacceptable tradeoffs
And whether tradeoffs are acceptable or not depends on tradeoffs. If you refuse to help find solutions that don't involve spying, don't get all flustered when a law is adopted that does involve spying!
> Either your communications are spied on to weed out unapproved material, or they're not.
Exactly. Apple's solution did not involve any spying. People have spoken against, now we have solutions that do involve spying. Let's see where this goes yeah?
Spying by your own device is still spying.
Upon detecting a suspect image, it takes action. The action isn't really part of the "algorithm". Depending on the score, Apple's whim of the day, and/or outside compulsion which would probably be applied to Apple, it refuses to allow the image to be sent in messages or to "the cloud", deletes the image, and/or reports the image to Apple (which would presumably report it further). They can change what it does at any time.
In other words, it examines data on your device, on behalf of others, in a way that you don't control, and uses the resulting information to your potential detriment, again on behalf of others and again in a way that you don't control.
Apple examining your data in a way you don't control, to implement policy that you don't control and may oppose, is spying. It doesn't matter whether they do the spying using you CPU or their CPU.
The only scenario where you don't need to accept things that are to your potential (and very real) detriment is if you don't live in society.
And no, what you described is not spying. Look up what it means: https://en.wikipedia.org/wiki/Espionage.
You are doing mental gymnastics. It's like calling a speeding fine "robbery", at best it's noise and not a useful contribution to discussion.
Where I live, police can't just randomly "check your documents" unless they already have some independent evidence supporting the idea that you might be involved in a crime. Which is how it should be.
It wouldn't be spying, though, since they'd be doing it openly and presumably not doing it on a continuing basis. It'd still be obscene authoritarian overreach.
> or speed/traffic camera is not "to your potential detriment",
These should of course be banned.
> or waiting in line to board the bus, etc.
This has nothing at all to do with anything and is just you trying to muddy the waters.
Yeah, then how about you match the description of a criminal. But it was an example and if you don't get the point then it's a waste of time.
> These should of course be banned.
Are you protesting them?
What if your kid gets run out by one of them speeders while walking out of school gates, will you still think speeding cameras are unnecessary?
> muddy the waters
These are all examples of having to suffer detriment due to living in a civilized society. You can pretend you don't but you do.
Why does this issue get techbros all up in arms-- I don't see them out protesting airport security checks etc. Somehow when their own lives are on the line then it's acceptable to require privacy invasive checks.
Either your communications are spied on to weed out unapproved material, or they're not. And there is no way to make the system architecture care about which material is allowed to be "unapproved".
The right answer here is just to accept that, beyond a certain point, further reducing the amount of circulating child porn requires unacceptable tradeoffs. Then stop whining and wishing for impossible technical solutions.