News for hackers. Stuff that matters.
Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @01:20PM (#33070657)
It was quite a thing to see Apple's huge "What Happens on iPhone, Stays on iPhone" billboards up around town, at the exact same time they were announcing the rollout of a new content-side illegal-material scan-and-notify system.

(I think they've since delayed the rollout of that system indefinitely, after public outcry.)

Re:Apple’s ad business set to boom on the back of its own an... by misnome on Monday October 03, 2022 @01:22PM (#33070689)
To be fair - wasn't that scanning on-device, and only uploading metadata on things that you yourself were already uploading to their cloud?
Re:Apple’s ad business set to boom on the back of its own an... by GekkePrutser on Monday October 03, 2022 @01:35PM (#33070878)
It was restricted to that for the time being yes. But still a big step in the wrong direction. I don't want my own phone spying on me. It's a bridge too far. Scanning on a cloud service is a very big difference.

Does it matter in practice? No. But it makes me feel very different about it. That's important too.

Re:Apple’s ad business set to boom on the back of its own an... by smoldesu on Monday October 03, 2022 @02:08PM (#33071379)
Same way I feel about it. When the data is on your servers, I fully expect it to be analyzed and checked to ensure it's compliant with the host's standards. That's part of our agreement, as customer and service. When you move that software onto the device I use, now I have to be conscious of everything I interact with. It's a horrible sinking feeling that isn't easily mitigated by platitudes like "we promise not to abuse it!"
Re:Apple’s ad business set to boom on the back of its own an... by freedomben on Monday October 03, 2022 @03:09PM (#33072232)
The Apple philosophy though is to think of the phone as an appliance, not a general purpose computer. The model of "ownership" is also a lot more gray with Apple devices. The idea that Apple has more control over the device than you do is the accepted norm. Given that, I think they could easily argue that your data is on their device, so analyzing/checking is expected. They've been slowly iterating more and more to this model for years, likely because I think a lot of people will not go along with it unless the heat turns up slowly.
Re:Apple’s ad business set to boom on the back of its own an... by Spooky23 on Monday October 03, 2022 @02:38PM (#33071820)
That’s exactly what they proposed to do.
Re:Apple’s ad business set to boom on the back of its own an... by smoldesu on Monday October 03, 2022 @03:12PM (#33072256)
I guess we have different definitions of "Apple's servers" then.
Re:Apple’s ad business set to boom on the back of its own an... by Spooky23 on Monday October 03, 2022 @03:52PM (#33072761)
When you sync or upload folder to iCloud, iCloud is Apple’s property. They were scanning content before it landed on Apple’s property to enable S2E crypto.

Sounds like you’re taking exception with the explicit parental notification, where a parent with a child enrolled in their iCloud “family” can request to be alerted when their minor child takes an action on the phone owned by the parent.

The EFF wrote an awful blog that deliberately confused the already confusing release from Apple. Your privacy is almost certainly weaker as a result, as various entities can use a subpoena or warrant to access your files.

Re:Apple’s ad business set to boom on the back of its own an... by falcolas on Monday October 03, 2022 @04:09PM (#33072970)
The problem is that the data wasn't on their servers, it was just flagged to go to Apple's servers.

And once you're scanning files with one flag set, nothing technologically prevents the scanning of files without that flag being set. And to quote myself from the Google Stadia brouhaha - "companies lie in PR statements" - so I have no reason to trust Apple's statement that they would never scan other files.

Re:Apple’s ad business set to boom on the back of its own an... by Spooky23 on Monday October 03, 2022 @10:14PM (#33076085)
You’re getting upset because they chose to tell you that this is happening.

The material that they scan for is illegal to possess. You should assume that anyone that accepts cleartext uploads of binary data is scanning for that and other material.

At the end of the day, you don’t have the juice to negotiate contractual protections, so corporate self-interest is really your only real protection.

Re:Apple’s ad business set to boom on the back of its own an... by falcolas on Tuesday October 04, 2022 @09:24AM (#33079977)
> The material that they scan for is illegal to possess.

Do you know what else is illegal to possess? Proof of abortions in some states. Proof of being gay in many countries. Winne the Pooh in at least one country.

> You should assume that anyone that accepts cleartext uploads of binary data is scanning for that and other material.

Again, since this seems to be lost every time, this isn't being checked post upload. That matters.

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:25PM (#33073904)
> And once you're scanning files with one flag set, nothing technologically prevents the scanning of files without that flag being set.

You need to read up on how the system worked, because they picked a design that made absolutely no sense if they wanted to do that. They’d have to redesign it to work in a different way if they wanted to do that.

Re:Apple’s ad business set to boom on the back of its own an... by smoldesu on Monday October 03, 2022 @06:06PM (#33074374)
You can read up on it, if you want. I'm not going to use iCloud if it scans my data before it hits Apple's servers.
Re:Apple’s ad business set to boom on the back of its own an... by misnome on Tuesday October 04, 2022 @07:18AM (#33078811)
If you don't trust them to do what they are saying, when they are saying it happens - then why on earth do you trust the device to not do it just by avoiding iCloud?
Re:Apple’s ad business set to boom on the back of its own an... by scarface74 on Monday October 03, 2022 @02:16PM (#33071479)
The phone was analyzing what you would be sending to the cloud.
Re:Apple’s ad business set to boom on the back of its own an... by falcolas on Monday October 03, 2022 @04:11PM (#33072996)
True. What stops it from analyzing other files on your phone? A policy block. It's simple to change policies (or be forced to change policies).
Re:Apple’s ad business set to boom on the back of its own an... by scarface74 on Monday October 03, 2022 @04:14PM (#33073039)
What’s stopping them from doing the same with your unencrypted photos in iCloud?

From a technical standpoint, at least you are protected from future policy changes if your files in the cloud are encrypted.

Understand, I am playing the devils advocate role more than anything else.

Re:Apple’s ad business set to boom on the back of its own an... by falcolas on Monday October 03, 2022 @04:16PM (#33073064)
Nothing. And since it's uploaded, I've agreed that it's OK for them to scan and report on them.

The key point I'm trying to make is that where the data is located matters for whether Apple (or Microsoft or Redhat or whichever company) has the ability or right to read and report on that data.

> at least you are protected from future policy changes if your files in the cloud are encrypted.

If, and only if, that data is never synced back to your phone (which Apples does currently).

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:26PM (#33073924)
> What stops it from analyzing other files on your phone? A policy block.

The phone would be literally incapable of determining if there were any matches. Please read up on how it was designed to work.

Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @02:01PM (#33071263)
Yes, that's fair and true -- they promised the scanning would self-limit to content being synched with iCloud.

But I think that's pretty thin gruel, since now you're just a feature-flag (or even a bug) away from all content being scanned. More broadly, the entire endeavor is very much at odds w/ the sentiment expressed in their public advertising.

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:29PM (#33073949)
> now you're just a feature-flag (or even a bug) away from all content being scanned.

That’s not true. The system didn’t work the way you are assuming. The device had no knowledge of any matches. The “scanning” was a coöperation of client-side and server-side code, each with an extremely limited knowledge of the data involved.

Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @07:08PM (#33074870)
I don't think you're correct -- the phone uploads security vouchers from photos, any photos, to Apple's servers. If enough of the vouchers match the image database, Apple can decrypt the vouchers to a low-rez version of the photos.

Apple says this would only be used on iCloud synced photos, but I don't see any technical reason the process could not be performed for any photo.

Am I mistaken?

> The device had no knowledge of any matches.

True, but how is it relevant?

Re:Apple’s ad business set to boom on the back of its own an... by Clent on Monday October 03, 2022 @02:17PM (#33071497)
The point the feature is lost here.

They want to scan on device so they do not have to scan it in the cloud.

Because people are in full FUD mode on this, we're stuck storing photos without full end-to-end encryption because Apple has do the scanning on their side.

Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @02:21PM (#33071561)
Well, there is another option: Apple could actually respect your privacy, support end-to-end encryption, and not scan your content at all.
Re:Apple’s ad business set to boom on the back of its own an... by lupire on Monday October 03, 2022 @03:04PM (#33072166)
They do, if you choose not to push your content into their servers.

If you don't want them to check for unwanted content, don't put your content on their machines.

Re:Apple’s ad business set to boom on the back of its own an... by Jcowell on Monday October 03, 2022 @02:35PM (#33071759)
How does this work in regards to a companies obligation (if there is one) to scan for illegal illicit material (I don’t feel like typing that term out that we all know) ?
Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @02:52PM (#33071996)
Sure, if the law requires it, then the company must do it. At that point, you are living under a rather intrusive government!
Re:Apple’s ad business set to boom on the back of its own an... by misnome on Tuesday October 04, 2022 @07:15AM (#33078791)
I don't think there are many governments in the western world that wouldn't get to that point. The entire point of client-side scanning was to head off the possibility of a law saying they have to scan everything server-side for the exact same reasons.

> Well, there is another option: Apple could actually respect your privacy, support end-to-end encryption, and not scan your content at all.

This is not an option you, or Apple, think there is to choose.

Peoples FUD and misrepresentation over what was happening and your snark over "yes but their advertising campaign says things stay on the phone" (which is literally true) is IMO likely actually accelerating the privacy degradation. When they are compelled by law to scan this all centrally in one place in the cloud, I guess you will be happier that it's more invasive but just happening "elsewhere"?

Re:Apple’s ad business set to boom on the back of its own an... by tablespoon on Monday October 03, 2022 @02:42PM (#33071868)
> To be fair - wasn't that scanning on-device, and only uploading metadata on things that you yourself were already uploading to their cloud?

On-device scanning like that would be pointless, though. IIRC, stuff uploaded to their cloud is already accessible to Apple for server-side scanning. The controversial thing was the on-device scans would trigger some kind of upload of un-uploaded stuff to Apple for further investigation.

Re:Apple’s ad business set to boom on the back of its own an... by misnome on Tuesday October 04, 2022 @07:06AM (#33078721)
> IIRC, stuff uploaded to their cloud is already accessible to Apple for server-side scanning. The controversial thing was the on-device scans would trigger some kind of upload of un-uploaded stuff to Apple for further investigation.

No, the stated behaviour was that it would be uploaded to the cloud at the same time as the encrypted image. Uploaded data was still "encrypted" "at rest" (but possible for them to decrypt, just not done routinely). The whole point of the client-side scanning was that scanning was done locally on the phone and uploaded with it, as an explicit alternative to them regularly decrypting and scanning all user data on their servers. The stated operation was; if the phone fingerprint matched a public CSAM fingerprint list, then it would be automatically decrypted and scanned with a second, private fingerprinting algorithm on the server - only if this second, private fingerprint matched would the data be flagged up for potential violation (and inspected).

The alternative to this was them just regularly scanning all data in their cloud anyway. Apparently people are happier with that option.

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:31PM (#33073974)
> The controversial thing was the on-device scans would trigger some kind of upload of un-uploaded stuff to Apple for further investigation.

No, a load of people assumed it would do that, but it’s not possible with the proposed scheme because the device had no knowledge of any matches.

Re:Apple’s ad business set to boom on the back of its own an... by lupire on Monday October 03, 2022 @03:02PM (#33072142)
Please provide a source for that claim.
Re:Apple’s ad business set to boom on the back of its own an... by yakubin on Monday October 03, 2022 @02:41PM (#33071860)
I wouldn't trust a corporation of this size to make sure there aren't recurring bugs which cause scanning of things I have on my device, but do not upload to their servers. If the code for scanning, flagging me and reporting to authorities is on the device, then I expect bugs (intentional or not) which will trigger it, even though I don't use iCloud. Put the scanning in the cloud, then I'll be fine with it - I don't use the cloud.

Also the scanning was calculating hashes based on content, not just metadata.

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:30PM (#33073959)
> If the code for scanning, flagging me and reporting to authorities is on the device

It’s not. The device has no idea if there are any matches. Everybody is assuming how it works without actually reading how it works.

Re:Apple’s ad business set to boom on the back of its own an... by NaturalPhallacy on Monday October 03, 2022 @02:34PM (#33071745)
Devil's advocate: "We kill people based on metadata." -Snowden
Re:Apple’s ad business set to boom on the back of its own an... by handedness on Monday October 03, 2022 @04:02PM (#33072876)
That statement was made by General Michael Hayden[0], former National Security Agency director, former Central Intelligence Agency director[1].

[0] https://youtu.be/kV2HDM86XgI?t=1072

[1] https://en.wikipedia.org/wiki/Michael_Hayden_(general)

Re:Apple’s ad business set to boom on the back of its own an... by NaturalPhallacy on Monday October 03, 2022 @06:23PM (#33074512)
Thanks for pointing that out! I'd heard it from Snowden, but didn't realize he wasn't the original source: https://twitter.com/theyesmen/status/652963715168534528
Re:Apple’s ad business set to boom on the back of its own an... by nonbirithm on Monday October 03, 2022 @03:35PM (#33072539)
I don't think it's possible to exist as a public-facing corporate entity without some kind of content scanning mechanism. If that were possible, then every child abuser would simply move their data onto those platforms and they'd become untouchable.

Even MEGA, which signals the virtues of privacy/security through the prominence of decryption keys on its UI flows, will still report illegal content to authorities and display a message saying so if content was removed for that reason.

Any publicly traded company that touts perfect privacy cannot deliver what they are claiming, or they'd become the service of choice for every type of disenfranchised person - including child abusers.

Apple has received much more flak than the average corporation over this issue because this fundamental impossibility of perfect privacy clashed with its own privacy signaling in a loud way, and the flurry of debate over the technical merits of the novel, widely shared on-device scanning solution caused much more scrutiny than the boring server-side scanning that has been ubiquitous for decades.

But the fact is that no matter how Apple tries to approach the CSAM problem, it will ultimately have to weed out child abusers from its servers or be publicly and legally lambasted. That is what society has decided is best for the welfare of children, and as a result we will have to live with an imperfect level of privacy as provided by such entities.

Re:Apple’s ad business set to boom on the back of its own an... by Spooky23 on Monday October 03, 2022 @02:38PM (#33071810)
Yup, and now your materials are in clear text on their service getting scanned routinely I’m sure.

That particular issue was the privacy advocacy people run amok.

Re:Apple’s ad business set to boom on the back of its own an... by scarface74 on Monday October 03, 2022 @01:40PM (#33070952)
Actually that’s perfectly in line with it “staying on your iPhone” that they were proposing to do content scanning on your phone. Not that I agree with it. But it is consistent.
Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @02:02PM (#33071295)
But results about matches don't stay on the phone, which I think is clearly a violation of the statement (unless you are interpreting it in an extremely literal way).
Re:Apple’s ad business set to boom on the back of its own an... by scarface74 on Monday October 03, 2022 @02:11PM (#33071422)
It only gets sent to Apple if you turned on iCloud photo syncing to send the photos to Apple.

That means the alternative would be to send the photos to Apple and Apple scans the photo. Either way you send the photo to Apple and meta data gets generated about CSAM. It’s just a matter of where the data gets generated.

I’m also uneasy about it happening on the phone. But honestly, by it being processed on the phone, that means it can be encrypted before it gets to Apple’s servers.

I’m basically working under the assumption that scanning for CSAM is legally required.

Re:Apple’s ad business set to boom on the back of its own an... by matthewdgreen on Monday October 03, 2022 @02:37PM (#33071799)
> I’m basically working under the assumption that scanning for CSAM is legally required.

It is explicitly not legally required in the US [1]. Providers are required to report "apparent CSAM" that they find on their own, but they are not compelled to search their servers or private devices for its presence.

And this is the case for a very good reason: if it was mandated by US law, then prosecutions would be subject to much stronger 4th amendment review under the "state action doctrine" (i.e., the companies are searching your files without probable cause as compelled representatives of the government.) The current arrangement evades this review under the very thin fig-leaf that US providers are doing the searching on their own.

[1] https://crsreports.congress.gov/product/pdf/LSB/LSB10713

Re:Apple’s ad business set to boom on the back of its own an... by lupire on Monday October 03, 2022 @03:09PM (#33072225)
FOSTA/SESTA and other law push back on that, wherein a neutral host (website, hotel) can be held responsible for crimes commited on their property if the government decides they are generally aware. Apple doesn't want to be an accessory. So even if they can't be required to scan, they can be punished for not scanning if something illegal turns up
Re:Apple’s ad business set to boom on the back of its own an... by matthewdgreen on Monday October 03, 2022 @04:22PM (#33073148)
IANAL and certainly don't want to defend those laws, but I believe FOSTA/SESTA ban providers from operating services with the intent to promote or facilitate various crimes. In other words, the provider has to knowingly distribute the material. I'm pretty sure that Apple encrypting its photo backup service would not satisfy these criteria, but if it did and the only way to comply with those laws was enforced CSAM scanning, then many CSAM prosecutions based on it would probably be tossed out.
Re:Apple’s ad business set to boom on the back of its own an... by dilap on Monday October 03, 2022 @02:38PM (#33071816)
As far as I know, it's not legally required, at least in the US, though I wouldn't be surprised if suggestions from gov behind the scenes were the inspiration for this. I guess the EU is in the process of trying to mandate something like this.

Which would be unfortunate. At that point, you won't be able maintain digital privacy from the govt w/o de-facto becoming a criminal.

CSAM is, I think, simply the initial justification for these systems, since it's widely reviled. But the system itself is not CSAM-specific, and the temptation to expand its scope will likely be irresistible.

If your goal was to become an authoritarian tyrant, you would be very happy to have this in place. :-)

Re:Apple’s ad business set to boom on the back of its own an... by JimDabell on Monday October 03, 2022 @05:32PM (#33073993)
> But results about matches don't stay on the phone

Results about matches aren’t ever on the phone in the first place. Only the server can determine if there are any matches.