News for hackers. Stuff that matters.
Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Sunday June 02, 2024 @05:20AM (#40552681)
You're right. But apparently every time this topic comes up we cry that this is abuse of our freedom.

Tech is not good or bad but it does have unintended consequences and open new ways for abuse. This is tough to swallow for us who work in tech but is obvious to everyone else. If we stay in denial and do not volunteer to help use tech smartly to compensate for bad side effects, they will vote in some dumb law and some bad guys will exploit it for surveillance later.

Re:Signal: Will leave the EU market rather than undermine ou... by BurningFrog on Sunday June 02, 2024 @06:42AM (#40553028)
Government recording all our conversations also has have "unintended" consequences.

The track record of such societies is rather terrifying.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Sunday June 02, 2024 @06:45AM (#40553040)
You think I disagree?
Re:Signal: Will leave the EU market rather than undermine ou... by yencabulator on Sunday June 02, 2024 @03:21PM (#40556583)
So, what's an example saner solution? Or is this one of those "just" sentences?
Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Sunday June 02, 2024 @05:40PM (#40557374)
Is it as "just" as "just ignore the abuse and keep making tools used for that purpose"?
Re:Signal: Will leave the EU market rather than undermine ou... by yencabulator on Sunday June 02, 2024 @08:46PM (#40558327)
Of all the things potentially worthy of "just", the status quo sounds most appropriate.

But I think you not being able to state what a saner solution is is enough for this conversation.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @05:47AM (#40560953)
Knowing you value minuscule amount of privacy over another person's life and suffering was already plenty.
Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Sunday June 02, 2024 @09:47AM (#40554088)
There is in fact no "smart" way to compensate for this particular "bad side effect".

Either your communications are spied on to weed out unapproved material, or they're not. And there is no way to make the system architecture care about which material is allowed to be "unapproved".

The right answer here is just to accept that, beyond a certain point, further reducing the amount of circulating child porn requires unacceptable tradeoffs. Then stop whining and wishing for impossible technical solutions.

Re:Signal: Will leave the EU market rather than undermine ou... by benfortuna on Sunday June 02, 2024 @10:52AM (#40554672)
There is in fact. You could build AI directly into the app to detect inappropriate content and block it.

The app has thus not violated end-to-end encryption, nor has that content been exposed to external parties.

Platforms could definitely do more.

Re:Signal: Will leave the EU market rather than undermine ou... by shinryuu on Sunday June 02, 2024 @12:44PM (#40555442)
And how do you deal with all false positives. That will just be deemed collateral damage?
Re:Signal: Will leave the EU market rather than undermine ou... by hellojesus on Sunday June 02, 2024 @01:02PM (#40555591)
To add to your excellent point, who gets to validate the models efficacy? How do we know the state hadn't trained it to report users talking about maga, or Isreal, or for those with Chinese national lovers?
Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Sunday June 02, 2024 @03:06PM (#40556486)
How do you deal with all those UUIDs colliding?

You can design a system where false positives are so rare they are insignificant and can be properly handled. The only reason we don't is because we don't think it's that much of a problem.

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Sunday June 02, 2024 @09:45PM (#40558647)
No, you can't. Machine learning doesn't work that way.

You can keep the false positive level reasonably low for copies of already known and flagged images. You can't do it for new images.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @05:46AM (#40560944)
Maybe you underestimate machine learning, if you check HN on any given day it can do anything, probably be the next president.

But flagged known images was the point of Apple's algo, for example. Still everyone just went "forget abuse, my privacy is more important for me". Really at this point techbros deserved any dumb law that lets the government read their chats.

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Monday June 03, 2024 @07:34AM (#40561647)
> Maybe you underestimate machine learning, if you check HN on any given day [...]

Maybe I actually know something about it.

> But flagged known images was the point of Apple's algo, for example.

You whined at me a little while ago about how all this was about "abuse, not just porn". Yet you're using that to justify a system that, as you describe it, could only find old, known images that have been circulating around the Internet and made it into a database. Meaning images of past abuse that cannot be prevented, by third parties who would not be caught by this.

Pick a threat model, because the measures you defend don't address the threats you claim justify them.

... and if you start talking about "grooming" or "normalization" or other silly bullshit that hypothetically might have a third-order effect, but probably doesn't have any meaningful effect at all in real life, I'm not going to bother to answer it.

> Still everyone just went "forget abuse, my privacy is more important for me".

Everybody's privacy is important to me. Including the privacy of the children whom you want to have grow up in an ever-expanding panopticon. Because this isn't just about stupid bullshit like your embarrassing disease. It's about people ending up in prison. It's about building infrastructure that can trivially and secretly be repurposed to hurt people, including children, in serious, life-changing, and potentially life-ending ways.

The Stasi were not a child-friendly institution.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @09:09AM (#40562293)
> Maybe I actually know something about it.

If you know then you'd agree that with the right setup ML can do this with a very high precision. We're talking about a highly customized system trained exactly for this one purpose not some chatbot.

> You whined at me a little while ago

You're the one whining here buddy-- remember this is about a law about to be forced on you that you find inconvenient ;) I find it suboptimal but in some sense it might be better than nothing.

> this was about "abuse, not just porn".

These are related. If you have this material, you obtained it from somewhere even if you didn't make it yourself. Some police work and it may lead to some dark web exchange marketplace and actual producers.

That said yes, there's difference. The EU law being discussed is probably more fit to counter realtime abuse, compared to Apple's algo for example.

> Because this isn't just about stupid bullshit like your embarrassing disease. It's about people ending up in prison.

I actually agree with these two sentences, but not in the way you probably intended.

> The Stasi were not a child-friendly institution.

I was waiting until Hitler gets invoked in a discussion about using tech to combat and prevent child abuse facilitated by tech, I was not disappointed.

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Monday June 03, 2024 @09:41AM (#40562548)
> If you know then you'd agree that with the right setup ML can do this with a very high precision.

No, it cannot.

Not with a model that you can run on a phone, no matter how specialized it is. Serious ML takes actual compute power (which translates to actual electricity).

Not with a model that you can train on the number of positive examples that are actually available. Current ML is massively hungry for training data.

Not with any model that's out there on people's phones and therefore subject to white-box attack. Adversarial examples are not a solved problem, especially not in the white-box environment.

Probably not with any model. You would need maybe a 0.0000001 false positive rate. That rate falls asymptotically with both model size and training.

> that you find inconvenient ;)

The last refuge of the fanatic is to call anybody who raises inconvenient objections a pedophile.

> I was waiting until Hitler gets invoked in a discussion about using tech to combat and prevent child abuse facilitated by tech, I was not disappointed.

The Stasi did not have anything to do with Hitler, and did not exist at all until after Hitler was dead. They were not part of the Nazi apparatus. Your ignorance of history helps to explain your willingness to give dangerous powers to untrustworthy insitutions, though.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @10:54AM (#40563214)
You would not need a perfect model, since there will have to be a human and due process in the loop.

> The last refuge of the fanatic

Between us two there's one with maximalist and absolutist views.

> call anybody who raises inconvenient objections

The actual objections are dealt with. Properly implemented (like Apple's algo) it's not spying, inconvenience and detriment of an individual is a fact of life in any society etc. We just trade personal attacks now.

> a pedophile

Putting words in my mouth.

> The Stasi did not have anything to do with Hitler, and did not exist at all until after Hitler was dead

Thanks for correcting me. So basically Stalin then. Wow, such difference.

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Monday June 03, 2024 @11:20AM (#40563542)
> Putting words in my mouth.

You know exactly what you intended to convey with that little smiley, so do I, and so does everybody else.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Tuesday June 04, 2024 @07:12AM (#40573115)
I don't know where to start .It's not only that you assume I imply you are a pedophile, you also think that would be a derogatory word or something? Pedophilia is not a crime (like being gay), sexual abuse is.

You're reading too much into this. The smile is there because you called me whining and I did the same to you.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Sunday June 02, 2024 @03:02PM (#40556468)
If you put "bad" in quotes, this means you don't think child abuse is actually bad? Cool.

> The right answer here is just to accept that, beyond a certain point, further reducing the amount of circulating child porn

Not porn, don't delude yourself. Actual abuse.

> requires unacceptable tradeoffs

And whether tradeoffs are acceptable or not depends on tradeoffs. If you refuse to help find solutions that don't involve spying, don't get all flustered when a law is adopted that does involve spying!

> Either your communications are spied on to weed out unapproved material, or they're not.

Exactly. Apple's solution did not involve any spying. People have spoken against, now we have solutions that do involve spying. Let's see where this goes yeah?

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Sunday June 02, 2024 @09:44PM (#40558637)
> Apple's solution did not involve any spying.

Spying by your own device is still spying.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @05:42AM (#40560916)
Try to understand how the algorithm works. If you do, please share the mental gymnastics routine you use to make it look like spying. It is not spying in any reasonable sense, definitely not the sense of the proposal by EU lawmakers.
Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Monday June 03, 2024 @07:23AM (#40561581)
It would attempt to identify child porn by scanning images (using both hashes and ML if I remember right, but it doesn't matter). This takes place on the local device, but under control of Apple, not the user.

Upon detecting a suspect image, it takes action. The action isn't really part of the "algorithm". Depending on the score, Apple's whim of the day, and/or outside compulsion which would probably be applied to Apple, it refuses to allow the image to be sent in messages or to "the cloud", deletes the image, and/or reports the image to Apple (which would presumably report it further). They can change what it does at any time.

In other words, it examines data on your device, on behalf of others, in a way that you don't control, and uses the resulting information to your potential detriment, again on behalf of others and again in a way that you don't control.

Apple examining your data in a way you don't control, to implement policy that you don't control and may oppose, is spying. It doesn't matter whether they do the spying using you CPU or their CPU.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @09:02AM (#40562254)
If "to your potential detriment" is your measure then tell me if you think police checking your documents is not "to your potential detriment", or speed/traffic camera is not "to your potential detriment", or waiting in line to board the bus, etc.

The only scenario where you don't need to accept things that are to your potential (and very real) detriment is if you don't live in society.

And no, what you described is not spying. Look up what it means: https://en.wikipedia.org/wiki/Espionage.

You are doing mental gymnastics. It's like calling a speeding fine "robbery", at best it's noise and not a useful contribution to discussion.

Re:Signal: Will leave the EU market rather than undermine ou... by Hizonner on Monday June 03, 2024 @09:27AM (#40562421)
> If "to your potential detriment" is your measure then tell me if you think police checking your documents is not "to your potential detriment",

Where I live, police can't just randomly "check your documents" unless they already have some independent evidence supporting the idea that you might be involved in a crime. Which is how it should be.

It wouldn't be spying, though, since they'd be doing it openly and presumably not doing it on a continuing basis. It'd still be obscene authoritarian overreach.

> or speed/traffic camera is not "to your potential detriment",

These should of course be banned.

> or waiting in line to board the bus, etc.

This has nothing at all to do with anything and is just you trying to muddy the waters.

Re:Signal: Will leave the EU market rather than undermine ou... by throwaway290 on Monday June 03, 2024 @09:44AM (#40562568)
> Where I live, police can't just randomly "check your documents" unless they already have some independent evidence supporting the idea that you might be involved in a crime.

Yeah, then how about you match the description of a criminal. But it was an example and if you don't get the point then it's a waste of time.

> These should of course be banned.

Are you protesting them?

What if your kid gets run out by one of them speeders while walking out of school gates, will you still think speeding cameras are unnecessary?

> muddy the waters

These are all examples of having to suffer detriment due to living in a civilized society. You can pretend you don't but you do.

Why does this issue get techbros all up in arms-- I don't see them out protesting airport security checks etc. Somehow when their own lives are on the line then it's acceptable to require privacy invasive checks.