News for hackers. Stuff that matters.
Re:Android 13 requires devices to have more than 2GB RAM and... by acchow on Friday September 09, 2022 @11:04PM (#32787343)
> To suggest that iOS is ahead in privacy is ludicrous.

On Android, you have a dad reported to the police and his Google account locked (including his Google Fi cellular plan) for taking photos of his toddler to send to the doctor https://www.nytimes.com/2022/08/21/technology/google-surveil...

Apple has not done this.

Re:Android 13 requires devices to have more than 2GB RAM and... by fyzix on Friday September 09, 2022 @11:11PM (#32787382)
The photos were synced to Google Drive where we know it would be scanned...which is fine. Apple's proposal would report you as soon as you took the picture.
Re:Android 13 requires devices to have more than 2GB RAM and... by Spartan-S63 on Friday September 09, 2022 @11:23PM (#32787456)
You're leaving out the detail that the CSAM scanning and detection would only occur if you upload your photos to iCloud. If you don't have iCloud photos turned on, the scanning wouldn't happen.

Additionally, scanning would happen on-device at time of upload and not on Apple's servers.

Re:Android 13 requires devices to have more than 2GB RAM and... by fossuser on Friday September 09, 2022 @11:51PM (#32787636)
Not only that but Apple’s only matched hashes of known CSAM kept in the NCMEC database.

Google meanwhile scans for algorithmically determined new content and ruins people’s lives without any ability to appeal (even after national news coverage): https://stratechery.com/2022/rights-laws-and-google/

Also Apple was clearly doing this so they could enable e2e encryption on iCloud.

Re:Android 13 requires devices to have more than 2GB RAM and... by kevin_thibedeau on Saturday September 10, 2022 @01:11AM (#32787977)
They were doing it as a favor to the DOJ to avoid an investigation into their business practices.
Re:Android 13 requires devices to have more than 2GB RAM and... by kikokikokiko on Saturday September 10, 2022 @03:56AM (#32788758)
To be fair they were probably doing it as a disguise to the real goal: spy on everything you do on your phone and send it to the "authorities", no questions asked. Before the autists noticed it after it was implemented, Apple simply announced beforehand that it's devices would start spying on you, but it's to protect the kids you know...
Re:Android 13 requires devices to have more than 2GB RAM and... by type0 on Saturday September 10, 2022 @08:21AM (#32789989)
> but it's to protect the kids you know...

Yeah, but the big question still remains, do they protect me from terrorists as well?

Re:Android 13 requires devices to have more than 2GB RAM and... by DesiLurker on Saturday September 10, 2022 @12:11PM (#32791888)
ya thats BS argument, I dont need my cellphone os to protect me from terrorists I need them to protect my privacy from unnecessary overreach from govt. having a completely surveilled society will will protect you from most of the attacks but to most people the cost will be unbearable. I thought that was quite settled after snow-den disclosures.
Re:Android 13 requires devices to have more than 2GB RAM and... by kevin_thibedeau on Saturday September 10, 2022 @01:09AM (#32787966)
> If you don't have iCloud photos turned on, the scanning wouldn't happen

At first. Then some legislator gets the bright idea mandate on-device scanning or someone adds a dark pattern to trick people into uploading to iCloud without realizing the ramifications. Having that capability is a threat to privacy even if it is initially configurable.

Re:Android 13 requires devices to have more than 2GB RAM and... by Gigachad on Saturday September 10, 2022 @03:29AM (#32788643)
This is what happened in the google case. The photos were immediately auto uploaded to google photos because that’s the default configuration.
Re:Android 13 requires devices to have more than 2GB RAM and... by MBCook on Friday September 09, 2022 @11:27PM (#32787480)
Apple’s proposal scanned for KNOWN abuse images. It didn’t try to identify NEW images the way Google did.

So in the same situation Apple’s proposal (which was designed with the input of many experts to avoid false positives and respect privacy) COULD NOT have flagged the father.

Re:Android 13 requires devices to have more than 2GB RAM and... by sentientslug on Friday September 09, 2022 @11:18PM (#32787415)
You are incorrect. A quick google search will show you that the Apple CSAM detection was only going to be implemented to photos uploaded to iCloud.
Re:Android 13 requires devices to have more than 2GB RAM and... by 58028641 on Friday September 09, 2022 @11:20PM (#32787433)
I was under the impression that Apple only planned to scan photos that would be uploaded to the cloud. Is that incorrect?
Re:Android 13 requires devices to have more than 2GB RAM and... by JohnBooty on Friday September 09, 2022 @11:54PM (#32787653)
They were planning to compare hashes/fingerprints of your photos against known, existing child porn images.
Re:Android 13 requires devices to have more than 2GB RAM and... by MBCook on Saturday September 10, 2022 @12:03AM (#32787705)
This is the thing that confuses me about this discussion.

Apple planned to look for known abuse images. People freaked out and they had to back down.

Google already scans for possible abuse images including new ones using AI. Thus it found and reported a father for a pic he had just taken.

And Apple is somehow the worse of the two.

Re:Android 13 requires devices to have more than 2GB RAM and... by kergonath on Saturday September 10, 2022 @04:14AM (#32788829)
Yeah lots of cognitive dissonance. Some people keep comparing what Apple could be instead of what they actually are. Google as a privacy champion is not something that is supported by reality.
Re:Android 13 requires devices to have more than 2GB RAM and... by matheusmoreira on Saturday September 10, 2022 @12:28AM (#32787800)
They're free to scan whatever they want on their computers. Not on mine. Especially not without my knowledge. I don't want anti-cheating and anti-malware software surveilling me either. Even the goddamn NSA has had data leaks because someone installed Kaspersky and it phoned home with a copy of some suspect data.
Re:Android 13 requires devices to have more than 2GB RAM and... by ec109685 on Saturday September 10, 2022 @01:44AM (#32788137)
They were adding a hash of a photo as metadata that is unreadable by everyone except Apple after you upload an image and only if it matches the hash of a known csam image.
Re:Android 13 requires devices to have more than 2GB RAM and... by Gigachad on Saturday September 10, 2022 @03:31AM (#32788652)
The whole OS is proprietary. You either trust apple to do what they say or you will have to run Android on a build you completely reviewed the source to.

If you want to act practically, scanning on your device is slightly better for privacy.

Re:Android 13 requires devices to have more than 2GB RAM and... by gpm on Saturday September 10, 2022 @12:12AM (#32787743)
Everyone agrees that stopping CSAM in a way that respects everyone rights is a good thing. We aren't making a results oriented objection to the goal, but a methods oriented objection.

The courts at least all agree that a company can be compelled to scan content in their possession, the creator of the content has no significant privacy rights. This is known as the third party doctrine. All Google is doing is doing this kind of scanning.

Apple meanwhile, wants to take your device (something that they cannot be compelled to do, due to the 4th amendment restriction against seizures) and use it to scan the content on your device (something they cannot be compelled to do, due to the 4th amendment restriction against searches) to decide whether or not there is illegal content on it.

The company violating you worse is pretty obviously the one doing things to you that the government couldn't compel them to do, because (if compelled) it would violate your rights.

Re:Android 13 requires devices to have more than 2GB RAM and... by ec109685 on Saturday September 10, 2022 @01:47AM (#32788151)
Apple isn’t compelled to proactively scan photos on iCloud.

The scanning on device was adding a hash to each photo only readable

  - if it matched a known csam image

  - multiple photos within the iCloud account match known csam images

  - the image was uploaded to iCloud
Compare that to Google where only the last point needs to be true in order to have Google run any algorithm they please on your photos looking for violative images.
Re:Android 13 requires devices to have more than 2GB RAM and... by MBCook on Saturday September 10, 2022 @12:28AM (#32787799)
But they were not not going to do it if you chose to use iCloud Photos. It’s basically a condition in the ToS, just like Google has one saying they can scan stuff in Google Photos.

It seems like hair-splitting to me. In both cases your photos are getting checked if you want to use the cloud storage service. Why is it worse to do on device (where it’s private) instead of on Google’s server (where you have to give them a plaintext copy of the photo)?

“Oh but Apple could change that with any update”. Couldn’t Google do the same with any update to Android, or even a Google Play Services update?

Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @12:50AM (#32787875)
>Why is it worse to do on device (where it’s private) instead of on Google’s server (where you have to give them a plaintext copy of the photo)?

Suppose you go to a public restroom and someone has installed a camera in there to perv on the people using it. That would be an invasion of your privacy, right? Now suppose someone installed a camera in your bathroom at your house. Would you say that's an equivalent invasion of your privacy?

Re:Android 13 requires devices to have more than 2GB RAM and... by JohnBooty on Saturday September 10, 2022 @12:05PM (#32791836)
Your analogy is way off base.

First: this was all, quite literally, about Apple wanting to NOT have access to your unencrypted photos.

In Apple's proposed plan, we would only be talking about hashes of pictures, and the comparison would be done by your device.

A fitting analogy would be if the "public restroom camera" snapped a Polaroid of you and asked you to compare it to a binder of known child porn, except somehow did this in a way that did not expose you to child porn and would not inconvenience you in any way and was guaranteed not to transmit the Polaroid somewhere else, and you had opted in to the whole process and there was another bathroom right next to it that required no such participation.

It's important to understand that Apple's on-device scanning plan was in the service of allowing E2E encryption.

The idea was to create a path by which they could comply with various current and upcoming CSAM legislation while still maintaining an E2E encryption flow.

Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @01:08PM (#32792495)
You're taking the analogy too literally. I was merely responding to the question posed by MBCook in general, not in this particular case. Performing an operation in the user's device is inherently more intrusive than performing the exact same operation in the server.

Incidentally, this scanning using hashes is indistinguishable from malware. Someone other than the user is instructing the device to perform operations that under no circumstances will benefit the user. Would this be tolerated if the list of hashes included copyrighted files, or prohibited books? I'm constantly disappointed by how effective "won't somebody please think of the children" is.

Re:Android 13 requires devices to have more than 2GB RAM and... by JohnBooty on Saturday September 10, 2022 @04:17PM (#32794264)
I certainly agree that "won't somebody please think of the children" has been exploited countless times in various shameful and downright evil ways.

(And tangentially, I'm not even sure that spotting traders of known CSAM is even a great way to combat the extremely real problem of pedophilia. Feels like another "war on drugs", where we target end users, as opposed to addressing the actual roots of the problem)

In a way, Apple is the victim of that here - they need to comply with laws based on "think of the children" rhetoric.

There are various current and proposed laws in various places around the world that compel Apple to share cloud content with various law enforcement agencies. Various current and future laws may compel Apple and other cloud hosts to actively scan for and report various things on behalf of government. This is... not great. I don't want to put words in your mouth, but I think we agree on that much?

We also agree that it is at best impractical for Apple to flaunt the law of nations, yes?

They are powerful, but they can't just defy federal law in a brazen and public way.

This is the context in which Apple's on-device image fingerprint scanning was conceived. They would like to enable E2E encryption for users for privacy's sake (because privacy is also a unique selling point vs. Google) while simultaneously complying with law.

If you want to argue that it sucks: sure. That's totally valid. The alternatives are certainly viable and even commendable: running your own "cloud", eschewing cloud storage, shunning smartphones entirely, etc.

However, it seems like most people like and want cloud storage.

Working within the constraints of "people want cloud storage" and "we can't openly defy multiple world governments", Apple's CSAM scanning proposal felt like clearly the best possible (least evil, if you prefer) cloud solution that doesn't involve exiting the market entirely or establishing their own offshore data centers and declaring them sovereign nations.

Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @05:09PM (#32794599)
>(And tangentially, I'm not even sure that spotting traders of known CSAM is even a great way to combat the extremely real problem of pedophilia. Feels like another "war on drugs", where we target end users, as opposed to addressing the actual roots of the problem)

Agreed.

>We also agree that it is at best impractical for Apple to flaunt the law of nations, yes?

It's unclear to me what law would be violated by both storing encrypted data on their systems that they don't have the keys for and not scanning client devices.

Re:Android 13 requires devices to have more than 2GB RAM and... by MBCook on Saturday September 10, 2022 @03:21PM (#32793783)
> Performing an operation in the user's device is inherently more intrusive than performing the exact same operation in the server.

Why? That’s the part I don’t get. People state that like it’s obvious on its face and it’s not to me.

If you perform an identical operation on a server, why is it better than performing the same operation on my device?

The result is identical. The inputs are identical.

Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @03:49PM (#32794054)
Well, because that's what "intrusive" means. Your property is being intruded into in order to use it for the benefit of someone other than you. Your property is yours. It's in your possession because you paid for it. It should only do something because you tell it to or because it will help it to better respond to your commands later. It should never act against your interests. You would not buy a microphone that eavesdropped on you, right? It should be equally unacceptable that your computers read your files, perform some computation on them, and send the results to some remote location without your intervention.

On the other hand, when you transfer your data to someone else's computer, you're relinquishing some control over it. Just like how your computer should serve you, that computer will serve its operator, and that operator's interests may be adversarial to you.

Re:Android 13 requires devices to have more than 2GB RAM and... by sfvegandude on Saturday September 10, 2022 @05:05PM (#32794569)
> It should be equally unacceptable that your computers read your files, perform some computation on them, and send the results to some remote location without your intervention.

I hear you. I really do. The world you describe is the world I want to live in.

But it’s not the world we live in. Your device is so complex, does so many operations per second, has so many sensors, sends so much data, receives so much data, that it is functionally impossible for a person to consent to everything that their device does. For all intents and purposes, you own the device, but have very little control over it. This has been true since smartphones came into existence.

So to take a stance like yours — and all-or-nothing stance, a declaration of sovereignty from the The Way It Works — is, I’m sorry to say, delusional. Demanding that perfect be the enemy of the good is exactly how we will sleepwalk into the dystopian surveillance state.

Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @06:03PM (#32794920)
You're looking at it the wrong way. You're saying that it's impractical to have perfect knowledge of everything the device is doing, but in fact that's not necessary. All it would take is to have laws that make it illegal to inspect data in a user's computer except by confiscating the device with a warrant. That would remove all incentive for LEO and companies acting on their behalf to pull stunts like these. It would also mean they would have to have very good tracking to prevent tainting of evidence (since it would otherwise be difficult to tell where a piece of data came from). Obviously this would not secure you from all attackers (e.g. imagine you want to keep some trade secrets, secret), but nothing other than good infosec would.

The problem is that a lot of people don't understand why privacy is important and why compromising it for what seems like good reasons is dangerous. Such people don't understand that some laws that make it easier to get away with crimes can still be good.

Re:Android 13 requires devices to have more than 2GB RAM and... by cma on Saturday September 10, 2022 @01:00PM (#32792414)
If they were going to enable e2e wouldnt that have to mean no manual review before reporting people to authorities?
Re:Android 13 requires devices to have more than 2GB RAM and... by MBCook on Saturday September 10, 2022 @10:05AM (#32790756)
So you’re against all scanning?
Re:Android 13 requires devices to have more than 2GB RAM and... by deadbeeves on Saturday September 10, 2022 @11:04AM (#32791264)
No, the analogy isn't perfect. It was just intended to show how both types of scanning are different. If someone agrees that installing a secret camera in a private bathroom is worse than in a public one, they should also agree that scanning files in someone's personal device is worse than scanning files in one's own server.

I think once you give someone else your unencrypted data, anything that happens to it afterwards is fair game. I assume at some point a human will snoop around my files.

Re:Android 13 requires devices to have more than 2GB RAM and... by infotogivenm on Friday September 09, 2022 @11:18PM (#32787419)
Do you have a source for that? I somewhat recall their proposal was only to ever scan photos uploaded to iCloud.
Re:Android 13 requires devices to have more than 2GB RAM and... by acchow on Saturday September 10, 2022 @01:11AM (#32787974)
The announcement was a little confusing, but Apple said they would scan photos being sent to iCloud but the scanning would occur on device (I suppose right before uploading).
Re:Android 13 requires devices to have more than 2GB RAM and... by hamandcheese on Friday September 09, 2022 @11:25PM (#32787460)
I believe that was the plan, initially, however the scanning was still happening on device. That has many people rightfully concerned that the scanning could extend to local-only images next.
Re:Android 13 requires devices to have more than 2GB RAM and... by infotogivenm on Friday September 09, 2022 @11:32PM (#32787512)
What a strange concern. Sending hashes of images as you take them to a remote server is very easy to do in any OS update, if they really wanted to betray their customer base's privacy expectations like that.

IMO the more logical guess as to the actual reason Apple wants to do this - to approach e2e encrypted iCloud photos in a LE-friendly way.

Re:Android 13 requires devices to have more than 2GB RAM and... by philistine on Saturday September 10, 2022 @09:54AM (#32790657)
The thing is they never announced e2e iCloud photos with the new process. So we could presume, but I honestly believe they never intend to give it to us.
Re:Android 13 requires devices to have more than 2GB RAM and... by hamandcheese on Saturday September 10, 2022 @03:21AM (#32788595)
iCloud backups are not e2e encrypted, though.

And I don’t think anyone was suggesting that Apple would secretly betray users. The concern is normalization of the notion of on-device scanning before (publicly) expanding the scope to all images.

Re:Android 13 requires devices to have more than 2GB RAM and... by infotogivenm on Tuesday September 13, 2022 @04:05AM (#32821735)
I was not suggesting this either... And yes, iCloud backups if you choose to use them are mostly not e2e encrypted (some important bits like iCloud keychain etc aside).

In any case, I think this concern of yours is unfounded, as echoed by many in the other comments below, and you should rethink it before continuing to push it.

The amount of scanning has not changed since the invention of corporate image hosting on the internet; you still cannot use iCloud to host known illegal content - they just moved where the scanning takes place. I don't see how this makes it any more likely or normalized to scan your non-iCloud photos.

Re:Android 13 requires devices to have more than 2GB RAM and... by j16sdiz on Saturday September 10, 2022 @03:50AM (#32788729)
If are talking about the whole device backup, Most of it are encrypted with your phone unlock pin or recovery code. Only iMessages (iirc) are not e2ee.
Re:Android 13 requires devices to have more than 2GB RAM and... by astrange on Friday September 09, 2022 @11:35PM (#32787540)
They have it backwards, scanning cloud uploads on device is more private than scanning them in the cloud.
Re:Android 13 requires devices to have more than 2GB RAM and... by hamandcheese on Saturday September 10, 2022 @03:27AM (#32788629)
Only if iCloud photos were e2e encrypted, which they are not. Then cloud scanning would necessarily mean removing the e2e encryption.

Since the photos are decryptable by keys in Apple’s possession, there is no real advantage to scanning on-device unless Apple/the government wanted to increase the scope of the scanning beyond iCloud.

https://support.apple.com/en-us/HT202303

Re:Android 13 requires devices to have more than 2GB RAM and... by astrange on Saturday September 10, 2022 @04:20AM (#32788851)
The advantage is that it doesn't use those keys, and you can see what it's doing. Less time spent ever decrypted = more private.
Re:Android 13 requires devices to have more than 2GB RAM and... by j16sdiz on Saturday September 10, 2022 @03:53AM (#32788743)
iCloud photo are not e2ee, but encrypted at rest. The key is encrypted with your password. Once you're logout, they are not supposed to be able to access them..
Re:Android 13 requires devices to have more than 2GB RAM and... by infotogivenm on Tuesday September 13, 2022 @04:09AM (#32821758)
This isn't true at all FWIW, except for the "encrypted at rest" part. "At rest" just means Apple doesn't dump them onto hard drives somewhere in plaintext. Their security model is documented in detail and is worth understanding.

https://support.apple.com/en-us/HT202303 https://support.apple.com/guide/security/welcome/web

Re:Android 13 requires devices to have more than 2GB RAM and... by sentientslug on Friday September 09, 2022 @11:34PM (#32787531)
It's illogical to fault Apple for something that they hadn't even talked about implementing ("local-only images" as you put it)
Re:Android 13 requires devices to have more than 2GB RAM and... by JimDabell on Saturday September 10, 2022 @02:22AM (#32788326)
> That has many people rightfully concerned that the scanning could extend to local-only images next.

Apple didn’t propose this, and the scheme that Apple did propose was very inconvenient if they actually wanted to do this. They would have had to redesign how the system worked to do it, at which point most of the system would become completely useless. Nobody would come up with a system like Apple’s if they wanted to do what you describe. There are much simpler ways to do that which would have saved Apple a lot of time and effort. The only reason to design a system like Apple’s is to limit knowledge in all directions as much as possible.

Nobody was rightfully concerned about this, they got outraged because they would rather jump to conclusions over headlines than take the time to read about how the scheme worked.

Re:Android 13 requires devices to have more than 2GB RAM and... by hamandcheese on Saturday September 10, 2022 @03:23AM (#32788608)
The only reason to design a system like Apple’s is so that it is impossible to opt out of once it is rolled out to non-iCloud photos.

iCloud photos are not e2e encrypted. If only iCloud photos were the true final target, there is absolutely no need for on-device scanning.

Re:Android 13 requires devices to have more than 2GB RAM and... by JimDabell on Saturday September 10, 2022 @07:20AM (#32789632)
> The only reason to design a system like Apple’s is so that it is impossible to opt out of once it is rolled out to non-iCloud photos.

This doesn’t make any sense because this system cannot be rolled out to non-iCloud photos. They would have to redesign how it worked. So the whole idea that Apple designed it this way for reasons that only kick in when it’s rolled out to non-iCloud photos is incoherent. If Apple were designing it for that purpose they would have picked a design that actually worked in those circumstances.

Re:Android 13 requires devices to have more than 2GB RAM and... by hamandcheese on Saturday September 10, 2022 @01:32PM (#32792701)
What about the design makes this only possible for iCloud? The scanning occurs on device. What limits it to only iCloud photos?
Re:Android 13 requires devices to have more than 2GB RAM and... by JimDabell on Sunday September 11, 2022 @01:04AM (#32796978)
Well it’s quite clearly integrated into the iCloud system. Why would you think that it works for local photos without iCloud?

A known CSAM photo gets added to photos on an iPhone with iCloud disabled – what happens next? What do you think is the mechanism for that getting reported?

Re:Android 13 requires devices to have more than 2GB RAM and... by philistine on Saturday September 10, 2022 @09:46AM (#32790581)
Apple’s proposal would have only worked against previously known pictures in the database maintained by the non-profit. The story we’re discussing here is due to machine learning deciding the pictures were CSAM.