News for hackers. Stuff that matters.
Re:Apple's child protection features spark concern within it... by hn_throwaway_99 on Thursday August 12, 2021 @08:52PM (#28163902)
This blog post got a lot of commentary on HN a couple days ago: https://news.ycombinator.com/item?id=28118350.

iMessages are already E2E encrypted, but you are correct, iCloud backups are decryptable with a warrant (and that was reportedly added at the FBI's request). But I agree with Ben Thompson's point in that blog post, that it's OK to not have strong, unbreakable encryption be the default, and that it's still possible to use an iPhone without iCloud and get full E2E.

But with Apple's CSAM proposal is NOT possible to have an iPhone that Apple isn't continuously scanning.

Re:Apple's child protection features spark concern within it... by prophesi on Thursday August 12, 2021 @10:51PM (#28164840)
> But I agree with Ben Thompson's point in that blog post, that it's OK to not have strong, unbreakable encryption be the default, and that it's still possible to use an iPhone without iCloud and get full E2E.

I disagree completely on this. For one, users aren't aware that using iCloud means that Apple has your decryption key and can thereby read and share all of your phone's data.

And two, opt-out is a dark pattern. Particularly if you surround it with other hurdles, like long click-wrap and confusing UI, it's no longer a fair choice, but psychological manipulation to have users concede and accept.

Third, as it's hinted, smarter criminals, the ones the FBI should actually worry about, will know to opt-out. So instead the vast majority of innocent users have their privacy violated in order to help authorities catch "dumb" criminals who could have very well been caught through countless other avenues.

disclaimer: I just read Bruce Schneier's "Click Here To Kill Everybody" after the pipeline ransomware attack, and these points come straight from it.

Re:Apple's child protection features spark concern within it... by y7 on Friday August 13, 2021 @03:49AM (#28166532)
I agree. If Apple wants to go this route, they should abstain from pushing the user towards using iCloud as they currently do, and instead just present a clear opt-in choice.

"Do you want to enable iCloud photos? Your private photos will be uploaded encrypted to Apple's servers, so that only you can access them. Before uploading, your photos will be locally scanned on your device for any illegal content. Apple will only be notified once a sufficient volume of illegal content is detected."

Re:Apple's child protection features spark concern within it... by mulmen on Friday August 13, 2021 @09:31PM (#28176949)
They moved away from the TimeCapsule model. If they were really committed to privacy there would be a small box you can put in your closet that provides iCloud storage functionality.
Re:Apple's child protection features spark concern within it... by bbarnett on Friday August 13, 2021 @06:16AM (#28167272)
Yes, but...

An option like this, after the lawyers get at it, will be 14 pages long.

"We can change this at any time", "except by court order", "no guarantee", "not liable", and on and on and on...

Re:Apple's child protection features spark concern within it... by oarsinsync on Friday August 13, 2021 @02:19PM (#28172381)
> Your private photos will be uploaded encrypted to Apple's servers, so that only you can access them.

This would be a large change from the way it works today, where Apple can view your iCloud photos. They’ve not made any statements indicating that is going to change.

Re:Apple's child protection features spark concern within it... by Nextgrid on Saturday August 14, 2021 @09:42AM (#28180535)
I don't see any reason to implement CSAM scanning on-device as opposed to doing it on the server if it wasn't to switch to a model where the server doesn't have access to the data.
Re:Apple's child protection features spark concern within it... by kirillzubovsky on Friday August 13, 2021 @12:04PM (#28170700)
Indeed, up until reading these comments I had no idea that iCloud wasn’t encrypted.

Everything about Apples messaging makes you believe otherwise. That seems pretty disingenuous.

Then again, 99% of consumers have very little choice that doesn’t include huddles and complicated setup. We all get the same moon goo, under a differ different brands.

Good, bad, or just the fact of life?

Re:Apple's child protection features spark concern within it... by porpoisemonkey on Friday August 13, 2021 @12:32PM (#28171106)
> Indeed, up until reading these comments I had no idea that iCloud wasn’t encrypted.

iCloud data is encrypted at rest (edit: except for Mail apparently). The type of encryption (service or end-to-end [E2E]) is specified here: https://support.apple.com/en-us/HT202303

It can be argued that from a user's viewpoint not having E2E encryption is tantamount to not having encryption at all, but from a technical standpoint the data is encrypted.

Re:Apple's child protection features spark concern within it... by heavyset_go on Friday August 13, 2021 @12:42PM (#28171269)
It's encrypted at rest, but Apple has the decryption keys, and will give up your customer data when asked to by the government[1]. Also, iCloud photos are not encrypted[2].

[1] https://www.apple.com/legal/transparency/us.html

[2] https://support.apple.com/en-us/HT202303

Re:Apple's child protection features spark concern within it... by porpoisemonkey on Friday August 13, 2021 @12:52PM (#28171407)
> Also, iCloud photos are not encrypted[2].

According to the table on the second link iCloud Photos are encrypted on the server (at rest). Am I missing something?

Re:Apple's child protection features spark concern within it... by mulmen on Friday August 13, 2021 @09:28PM (#28176932)
They are encrypted at rest. This protects from someone hacking in to Apple, getting the data on disk but somehow not getting the keys, which Apple also possesses.

Apple (and thus, LEO) absolutely can look at your photos on iCloud. What you are missing is that "encrypted at rest" is essentially "not encrypted in any meaningful way".

Re:Apple's child protection features spark concern within it... by prophesi on Friday August 13, 2021 @01:33PM (#28171899)
This is more from Schneier's book, but I would say the most import reason E2E encryption should be the default is that in the event of a data breach, nothing would be lost. If a company's servers are hacked, they'd have access to the symmetrical encryption keys, and therefore all of the data. It also ensures that the company can't be selling/sharing your data, as they don't have access to it in the first place.

Edit: I also meant iCloud backups in my original post and how Apple can decrypt your E2E encrypted iMessages with the key the backups contain. But I posted it last night and couldn't edit it once I caught the error. It would be amazing for other iCloud services to have E2E encryption so long as the implications of iCloud backups having your encryption keys is stated front and center when choosing to opt-in.

Re:Apple's child protection features spark concern within it... by codedokode on Saturday August 14, 2021 @08:26AM (#28180105)
What are the advantages of having unencrypted cloud backups? The only advantage is that authoritarian governments can better control their citizens. Apple is playing on the side of dictators instead of protecting their users.
Re:Apple's child protection features spark concern within it... by tlholaday on Sunday August 15, 2021 @01:43PM (#28190657)
> What are the advantages of having unencrypted cloud backups?

Unsophisticated users who have lost or forgotten their passphrase can recover their data.

Re:Apple's child protection features spark concern within it... by pyuser583 on Saturday August 14, 2021 @11:52PM (#28186130)
It is encrypted. But Apple controls the key.
Re:Apple's child protection features spark concern within it... by speleding on Friday August 13, 2021 @05:12AM (#28166945)
As someone who frequently has to help older family members recover from lost passwords and broken phones, I sincerely hope they leave strong encryption of backups to be "opt out".

It's fine if you know you want to be the sole person in the world who can get to your data and have the discipline to store master passwords, and you accept Apple support cannot help you even if you have a purchase receipt for the device. But for the average older person that's not a good default.

Re:Apple's child protection features spark concern within it... by londons_explore on Friday August 13, 2021 @05:36AM (#28167065)
> help older family members recover from lost passwords and broken phones,

Apple just needs to design good UX to help these people.

Perhaps a large cardboard 'key' comes with every phone. When first setting up the phone, you scan a QR code on it to encrypt your data with the key, and then you tell the owner that of they ever lose the key to their phone, they won't be able to get in again.

People understand that - it's like losing the only key to a safe.

From time to time you require them to rescan the key to verify they haven't lost it, and if they have, let them generate a new one.

Re:Apple's child protection features spark concern within it... by GekkePrutser on Friday August 13, 2021 @08:07AM (#28167904)
You don't want that key to be in the box. Because of Apple printed it, they know it.

It's better if the key is generated when you already have the phone.

Re:Apple's child protection features spark concern within it... by Nextgrid on Saturday August 14, 2021 @09:44AM (#28180553)
Well if the alternative is the current situation where Apple has access anyway, a key that Apple may know is still a better idea.

For even better security they can instead provide an NFC smartcard or hybrid NFC + USB (like a Yubikey) where the key is stored in hardware and can't be extracted.

Re:Apple's child protection features spark concern within it... by bqmjjx0kac on Saturday August 14, 2021 @04:52PM (#28183844)
Apple also pushes software updates to the phone, so does it really matter? I'd be more concerned about a third party intercepting and copying the key.
Re:Apple's child protection features spark concern within it... by cameronbrown on Friday August 13, 2021 @07:36AM (#28167725)
Far easier to develop a culture of using something physical like yubikeys - over flimsy cardboard QR codes. The key metaphor makes a lot more sense that way, too.
Re:Apple's child protection features spark concern within it... by WastingMyTime89 on Friday August 13, 2021 @07:09AM (#28167566)
So you are suggesting making everyone life more cumbersome with the very likely potential of losing all the data on your phone because you lost a piece of cardboard or forgot a key for which benefit exactly? Being hypothetically safe for government scrutiny concerning information they could a dozen other way?

I really like E2E encryption of messages with proper backups on my end. It's good to know the carrier of my messages can't scan them for advertising purpose. But for my phone if I know there is no way to easily get the data back if I have an issue that seems like a major hassle with very little upsides.

Re:Apple's child protection features spark concern within it... by cheschire on Friday August 13, 2021 @01:37AM (#28165794)
I dunno, when I read the choices in iTunes about backups, I didn’t feel particularly manipulated. It seemed straight forward. Trade offs were clear to me.

I guess some people just see dark patterns where I don’t.

Re:Apple's child protection features spark concern within it... by ElFitz on Friday August 13, 2021 @03:28AM (#28166417)
The least of the biases at play, here, is the change aversion bias.

Making things "opt-out", without even making it hard, dramatically increases the number of people who opt-in. It can be used for many reasons.

For example, the UK switched it’s organ donation laws from opt-in to opt-out.

Another example, my government has decided that them selling their citizen's personal information to garages, insurance companies, etc, when we buy cars, should also be opt-out.

So they freely sell the car make, acquisition date, buyer's name,… [1][2]

Unless it has changed with GDPR. I’ve never bought a car.

While we're on the topic of GDPR, that is exactly why it insists on making cookies, tracking, and the "sharing of information with partners" opt-in.

And that is without hiding what you’re doing, making it unclear or confusing, or requiring multiple actions to change it.

(Links in French, sorry)

[1]: https://mobile.interieur.gouv.fr/Repertoire-des-informations...

[2]: https://www.carte-grise.org/actus/2014/05-12-L-Etat-vends-le...

Re:Apple's child protection features spark concern within it... by jjgreen on Friday August 13, 2021 @08:30AM (#28168062)
For example, the UK switched its organ donation laws from opt-in to opt-out.

We have, yet oddly, it's still called "organ donation".

Re:Apple's child protection features spark concern within it... by grkvlt on Friday August 13, 2021 @10:06AM (#28168999)
don't be disingenuous - fairly obviously it is a donation because it is optional, voluntary and non-compensated.
Re:Apple's child protection features spark concern within it... by jjgreen on Saturday August 14, 2021 @04:42AM (#28179109)
voluntary (adjective) done, made, or given willingly, without being forced or paid to do it (Cambridge)

How is my will involved here?

Re:Apple's child protection features spark concern within it... by ElFitz on Saturday August 14, 2021 @10:55AM (#28181128)
Because you only have to express it for it to be respected.

Which is the bare minimum if you want others to be able to even consider respecting it.

The default choice being, in the absence of any information, the one that increases chances of survival of actually living humans doesn’t seem misguided to me.

——

If you want compulsory and overreaching (although not necessarily bad. Got no opinion on that aspect) rules, over here we:

- can’t disinherit a descendant. The state decides the minimum each one of your genetic or legal relatives can get from your assets

- have to financially support our adult children until an arbitrary time decided by the law

- have to support and assist our parents and grand-parents if they can’t provide for themselves

- basically can be legally compelled to financially assist any ascendant or descendant

- may end up having to pay up after a divorce, even if you had an iron-clad contract, to compensate for the loss of QoL of the spouse with a lesser income

Re:Apple's child protection features spark concern within it... by jjgreen on Sunday August 15, 2021 @05:31AM (#28187420)
Because you only have to express it for it to be respected.

... and if you do not know that an opt-out is required to not have your organs removed, then how can it be said that you have willingly contributed them. And if your organs are removed by default, without you actually willing that this be the case, then how can this practice be called "donation"?

So instead, shall we call it "organ retrieval", "organ harvesting" and so on? All rather ugly words. But when the words that accurately describe what you are doing appear ugly, instead of looking for words which inaccurately describe what you are doing, perhaps you should ask yourself if you should be doing what you are doing.

Re:Apple's child protection features spark concern within it... by grkvlt on Wednesday August 18, 2021 @05:23PM (#28227367)
so, basically your only problem is that the possibility of opt-out may not be adequately communicated? and, i think everyone would agree that changing the law but not telling anyone would be bad and wrong. but, spoiler alert, that didn't happen. and if we found someone who could or did not understand, the default would be to not use their organs.
Re:Apple's child protection features spark concern within it... by jjgreen on Sunday August 22, 2021 @07:24AM (#28264582)
They're dead, so it's often a bit tricky to find out. What you could do is have some way of recording that people have been told about the opt-out, then they could carry a card around with them that says "I have been informed of the opt-out and choose not to, please take my organs". Only take the organs if they are carrying such a card.

And I'd be interested to know of the percentage of UK adults who are aware of the opt-out. I had a search around but couldn't find any surveys, are you aware of any?

Re:Apple's child protection features spark concern within it... by grkvlt on Thursday August 26, 2021 @11:56AM (#28316586)
good question. every household got a big blue envelope with large print writing in it saying something like 'important information about organ donation changes' (or similar, can't find my copy now) and a pamphlet inside. like i said, this was sent to every household, so it does miss the homeless, illiterate and non english speakers (although the pamphlet had instructions in other languages explaining how to access more information) and there were press, radio, tv, internet and outdoor adverts, as i recall. i mean, only covid-19 health information dissemination has been more extensive recently. but, you're right, would be interesting to know how effective the campaign was, and im sure they checked, since it cost a fair bit of public money, so the information should be available somewhere online...
Re:Apple's child protection features spark concern within it... by mulmen on Friday August 13, 2021 @09:33PM (#28176967)
Is it really voluntary if it is opt-out?
Re:Apple's child protection features spark concern within it... by ElFitz on Saturday August 14, 2021 @10:38AM (#28180999)
There’s a reason why they strongly encourage people to make their preference clearly known to family & friends.

Because most often, when there’s even the sliver of a doubt on the deceased one's wishes, the corpse will keep all it’s organs to the grave / incinerator.

Re:Apple's child protection features spark concern within it... by js2 on Thursday August 12, 2021 @08:57PM (#28163947)
> But with Apple's CSAM proposal is NOT possible to have an iPhone that Apple isn't continuously scanning.

As currently implemented, iOS will only scan photos to be uploaded to iCloud Photos. If iCloud Photos is not enabled, then Apple isn't scanning the phone.

Re:Apple's child protection features spark concern within it... by hn_throwaway_99 on Thursday August 12, 2021 @09:07PM (#28164040)
Woops, you're right, thanks for the correction.

I think the issue is that, as Ben Thompson pointed out, the only thing preventing them from scanning other stuff now is just policy, not capability, and now that Pandora's box is open it's going to be much more difficult to resist when a government comes to them and says "we want you to scan messages for subversive content".

Re:Apple's child protection features spark concern within it... by tshaddox on Thursday August 12, 2021 @09:31PM (#28164239)
Given that they obviously already have the capability to send software updates that add new on-device capability, this seems like a meaningless distinction. It’s already “just policy” preventing them from sending any conceivable software update to their phones.
Re:Apple's child protection features spark concern within it... by hn_throwaway_99 on Thursday August 12, 2021 @09:46PM (#28164332)
I disagree, strongly. Let's say you're authoritarian government EvilGov. Before this announcement, if you went to Apple and said "we want you to push this spyware to your iPhones", Apple would and could have easily pushed back both in the court of public opinion and the court of law.

Now though, Apple is already saying "We'll take this database of illegal image hashes provided by the government and use it to scan your phone." It's now quite trivial for a government to say "We don't have a special database of just CSAM, and a different database of just Winnie the Pooh memes. We just have one big DB of 'illegal images', and that's what we want you to use to scan the phones."

Re:Apple's child protection features spark concern within it... by emodendroket on Thursday August 12, 2021 @11:16PM (#28165000)
Could they though? An authoritarian government could just as easily say "if you do not implement this feature, we will not allow you to operate in this country" and refuse to entertain legal challenges.
Re:Apple's child protection features spark concern within it... by zarzavat on Friday August 13, 2021 @03:03AM (#28166284)
Authoritarian countries are the least of the worries. There's a large class of illegal imagery that is policed in democratic countries: copyrighted media. We are only two steps away from having your phone rat you to the MPAA because you downloaded a movie and stored it on your phone.

I can guarantee that some industry bigwigs are salivating at the prospect of this tech. Imagine youtube copyright strikes but local to your device.

Re:Apple's child protection features spark concern within it... by kmeisthax on Friday August 13, 2021 @10:26AM (#28169261)
This would have been a huge fear of mine if this was 10 or 15 years ago and legitimate publishers were still engaging in copyright litigation for individual noncommercial pirates. The RIAA stopped doing individual lawsuits because it was surprisingly expensive to ruin people's lives that way over a handful of songs. This largely also applies to the MPAA as well. The only people still doing this in bulk are copyright trolling outfits - companies like Prenda Law and Malibu Media. They make fake porn, covertly share it and lie to the judge about it, sue you, and then offer a quick and easy settlement route.

(Yes, I know, it sounds like I'm splitting hairs distinguishing between copyright maximalism and copyright trolling. Please, humor me.)

What copyright maximalists really want is an end to the legal protections for online platforms (DMCA 512 safe-harbor) so they can go after notorious markets directly. They already partially accomplished this in the EU. It's way more efficient from their end to have one throat to choke. Once the maximalists get what they want, platforms that want to be legitimate would be legally compelled to implement filters, ala YouTube Content ID. But those filters would apply to content that's published on the platform, not just things on your device. Remember: they're not interested in your local storage. They want to keep their movies and music off of YouTube, Vimeo, Twitter, and Facebook.

Furthermore, they largely already have the scanning regime they want. Public video sites make absolutely no sense to E2E encrypt; and most sites that deal in video already have a content fingerprinting solution. It turns out it was already easy enough to withhold content licenses to platforms that accept user uploads, unless they agreed to also start scanning those uploads.

(Side note: I genuinely think that the entire concept of safe harbors for online platforms is going to go away, just as soon as the proposals to do so stop being transparently partisan end-runs around the 1st Amendment. Pre-Internet, the idea that an entity could broadcast speech without having been considered to be the publisher of it didn't really exist. Publishers were publishers and that was that.)

Re:Apple's child protection features spark concern within it... by noduerme on Friday August 13, 2021 @04:22AM (#28166707)
One reason I haven't used itunes in years, and don't use iOS, is that I have a huge collection of mp3s. It's almost all of music which I bought and burned off CDs over decades, and it's become just stupidly difficult to organize your own mp3 collection via Apple's players. Even back in the ipod days, you could put your mp3s on an ipod but you needed piracy ware to rip them back off. I can easily see this leading to people like me getting piracy notices and having to explain that no, I bought this music, since we're now in a world where not that many people have their own unlocked music collection anymore.
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @10:00AM (#28168929)
They still sell iTunes Match subscriptions, a service entirely premised on you having your own MP3s.
Re:Apple's child protection features spark concern within it... by FridayoLeary on Friday August 13, 2021 @11:25AM (#28170078)
You could access the music no problem, just some metadata was messed up.
Re:Apple's child protection features spark concern within it... by ElFitz on Friday August 13, 2021 @03:38AM (#28166476)
> Authoritarian countries are the least of the worries.

That really depends. And is quite a strange, perhaps worrying, take.

Because, for many people, copyright strikes are the least of their problems.

Not that I disagree on it being an issue.

Re:Apple's child protection features spark concern within it... by zarzavat on Friday August 13, 2021 @07:00AM (#28167504)
The only authoritarian country that holds any sway over Apple is China and China can easily just ban iPhones if they feel like it, especially with Xi Jinping in charge.

Democratic countries are much more of a danger because Apple has offices in them and cannot easily pull out of the market if they feel the laws are unconscionable.

Re:Apple's child protection features spark concern within it... by shantara on Friday August 13, 2021 @10:21AM (#28169185)
Russia already forced Apple to allow pre-installing government approved apps on local iPhones: https://www.theverge.com/2021/3/16/22334641/apple-follows-ru...
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @07:39AM (#28167738)
I think Apple is pretty tied to China both as a market for their goods and as the place they get manufacturing done.
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @07:49AM (#28167804)
All these years I have heard of people getting in trouble for sharing copyrighted materials with others but never for possessing them or downloading them (BitTorrent somewhat blurs the line here). And there's nothing illegal about ripping your own CDs. I find this scenario far-fetched. iTunes Match would seem to be a longrunning honeypot if you take this seriously.
Re:Apple's child protection features spark concern within it... by adrianN on Friday August 13, 2021 @12:33AM (#28165478)
Apple is a fairly large company, that gives them some monetary leverage over governments. It's not as simple as you make it seem, I think.
Re:Apple's child protection features spark concern within it... by pjerem on Friday August 13, 2021 @01:25AM (#28165747)
Should this fact be reassuring or even more frightening ?

Because it’s something to push back against governments by saying « I can’t ». But it’s a societal issue if a corporation can say « I don’t want » to a government.

It’s really not the same thing and Apple just burned their « I can’t » card and are implying they can just say « no » to governments. Which is quite an even more dystopian thing.

Re:Apple's child protection features spark concern within it... by spacedcowboy on Friday August 13, 2021 @01:19PM (#28171748)
They can say "no" but they have to cope with the fallout from that.

The statement from Apple is that they will say no. Whether that actually ever happens is something we will see, one way or another.

Re:Apple's child protection features spark concern within it... by pseudalopex on Friday August 13, 2021 @03:25PM (#28173367)
Apple won't say no to a court order.
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @03:41PM (#28173593)
Of course they won't. The idea of a company refusing to comply with the laws of the countries they operate in purely out of some grand sense of principle just seems naive. Especially if it's the country where HQ is.
Re:Apple's child protection features spark concern within it... by ElFitz on Friday August 13, 2021 @03:32AM (#28166444)
China just hung it's biggest tech companies out to dry.

Do you really think they would care in the slightest about banning iPhone?

Or that Putin cares more about people not being able to buy what amounts to a luxury item, than being able to hunt down opposition supporters?

Re:Apple's child protection features spark concern within it... by adrianN on Friday August 13, 2021 @03:56AM (#28166574)
Yeah I'm pretty sure that this wasn't an easy decision for the Chinese government. Even in dictatorships you can't afford to piss off the population too much.
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @07:44AM (#28167772)
I'm not sure a move to soak rich guys getting a little too big for their britches is that unpopular with the general population.
Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @07:43AM (#28167762)
Google is pretty big too but they implemented the filtering in China as requested. Then when they decided they didn't want to do that anymore there went their site.
Re:Apple's child protection features spark concern within it... by laserlight on Friday August 13, 2021 @04:02AM (#28166608)
Is there a guarantee that Apple will retain their monetary status, or even, money will be a leverage over governments in future?
Re:Apple's child protection features spark concern within it... by brandon272 on Friday August 13, 2021 @12:38AM (#28165509)
Who wants to be the government who shuts down Apple? These are politicians we are talking about.
Re:Apple's child protection features spark concern within it... by ElFitz on Friday August 13, 2021 @03:36AM (#28166461)
Those already doing far worse than banning a consumer electronics company's products?

And, in all honesty, there's a lot of those.

Re:Apple's child protection features spark concern within it... by brandon272 on Friday August 13, 2021 @12:30PM (#28171081)
I meant in the context of U.S. governments. What Democrat administration wants to ban Apple? What Republican administration wants to ban Apple?

Sounds like political suicide on either side: government interference with the country's largest company, an iconic brand, for no reason other than to hopefully spy more on your citizens.

Re:Apple's child protection features spark concern within it... by emodendroket on Friday August 13, 2021 @12:41PM (#28171243)
The concern being raised is about some unnamed authoritarian government without US legal norms, though.
Re:Apple's child protection features spark concern within it... by ctdonath on Saturday August 14, 2021 @08:31AM (#28180133)
Analogy: the prospect of “vaccine passports” for jurisdictional movement and access is getting serious consideration at all levels of U.S. governance. Not long ago, anything so resembling “papiere, bitte” commonly inspired a sense of violent resistance against totalitarianism. Just takes one engaging “but this is different” to reframe the worst of humanity to popular compulsion.
Re:Apple's child protection features spark concern within it... by emodendroket on Saturday August 14, 2021 @12:33PM (#28181951)
There is nothing novel about them besides the name.
Re:Apple's child protection features spark concern within it... by nl on Friday August 13, 2021 @12:45AM (#28165552)
Who wants to be the government that bans Winnie the Pooh?

Ohh... oops.

Re:Apple's child protection features spark concern within it... by loyukfai on Friday August 13, 2021 @02:52AM (#28166209)
Chinese Apple users already have their data treated differently.

Any chance this is already operational there?

Re:Apple's child protection features spark concern within it... by strogonoff on Friday August 13, 2021 @03:37AM (#28166464)
> Apple is already saying "We'll take this database of illegal image hashes provided by the government and use it to scan your phone."

This is incorrect.

Apple has been saying—since 2019![0]—that they can scan for any potentially illegal content, not just images, not just CSAM, and not even strictly illegal.

That's what should be opposed. CSAM is a red herring.

[0] https://www.macobserver.com/analysis/apple-scans-uploaded-co...

Re:Apple's child protection features spark concern within it... by noduerme on Friday August 13, 2021 @04:14AM (#28166677)
The difference is that's scanning in the cloud, on their servers, of things people choose to upload. It's not scanning on the user's private device, and currently they have no way to scan what's on a private device.
Re:Apple's child protection features spark concern within it... by strogonoff on Friday August 13, 2021 @05:22AM (#28166990)
The phrase is “pre-screening” of uploaded content, which is what is happening. I'm pretty sure this change in ToS was made to enable this CSAM feature.
Re:Apple's child protection features spark concern within it... by ribosometronome on Thursday August 12, 2021 @10:47PM (#28164801)
Why do you think essentially no one is complaining about using ML to understand the content of photos, then (especially in comparison to this rather targeted CSAM feature)? My impression is that both Apple and Google have already been doing that since what? 2016? Earlier? There's been no need for a database of photos, either company could silently update those algorithms to ping on guns, drugs, Winnie the Pooh memes, etc.
Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:29AM (#28165759)
Why do you think essentially no one is complaining about using ML to understand the content of photos…

At last in Apple's case, ML is used only if a minor child (less than 13 years old) who is on a Family account where the parent/guardian has opted-in to the ability to be alerted if potentially bad content is either sent or received using the Messages app.

Re:Apple's child protection features spark concern within it... by ChrisKnott on Friday August 13, 2021 @02:37AM (#28166130)
By default iPhones autocategorise your photos, don't they?
Re:Apple's child protection features spark concern within it... by katbyte on Friday August 13, 2021 @06:06AM (#28167223)
The sure do, and now extract text from images
Re:Apple's child protection features spark concern within it... by ribosometronome on Friday August 13, 2021 @02:35PM (#28172596)
Google and Apple both use ML to understand the content of photos already. Go into your app and you can search for things like "dog", "beer", "birdhouse", and "revolver". Given that it can do all that (and already knows a difference between type of guns), it doesn't seem like a stretch to think it could, if Apple or Google wanted, understand "cocaine", "Winnie the Pooh memes", or whatever repressive-government style worries are had. And it's existed for years, without slippery sloping into anything other than this Messages feature for children.
Re:Apple's child protection features spark concern within it... by ctdonath on Saturday August 14, 2021 @08:38AM (#28180164)
Bingo. All Apple has done is add another category for “nude child” with a simple notification when the AI finds one. The tech has arrived; consequences happen.
Re:Apple's child protection features spark concern within it... by salawat on Thursday August 12, 2021 @11:22PM (#28165027)
raises hand

Have been whining about big data for and ML recognition systems for years.

Re:Apple's child protection features spark concern within it... by spacedcowboy on Friday August 13, 2021 @01:25PM (#28171822)
There is so much disinformation about this with people not being informed. Apple have put out clear documentation, it would be a good idea to read it before fear-mongering.

1) The list of CSAM hashes is that provided by the relevant US government agency, that is it.

2) The project is not targeted to roll out anywhere other than the USA.

3) The hashes are baked into the OS, there is no capability to update them other than on signed and delivered Apple OS updates.

4) Apple has exactly the same leverage with EvilGov as at any other time. They can refuse to do as asked, and risk being ejected from the country. Their stated claim is that this is what will happen. We will see.

Re:Apple's child protection features spark concern within it... by benmmurphy on Saturday August 14, 2021 @06:16AM (#28179548)
Regarding 3: it’s very easy to make a mistake in the protocol that would allow apple to detect hashes outside the CSAM list. Without knowing exactly how their protocol works it’s difficult to know whether it is correct.

https://www.apple.com/child-safety/pdf/CSAM_Detection_Techni...

For example here is a broken PSI protocol in terms of point 3. I don’t think normally in PSI this is considered broken because the server knows the value so it is part of its private set.

Server computes M_s = g . H(m) . S_s

where g is a generator of an elliptic curve, H(m) is the neural hash of the image and S_s is the server blinding secret.

The client computes M_sc = M_s . S_c where S_c is the client ephemeral secret. This M_sc value is the shared key.

The client also computes M_c = g . H(m) . S_c

and sends the M_c value to the server.

The server can now compute M_cs = M_c . S_s = M_sc since they both used the same H(m) values. This allows the server and client to share a key based on the shared image.

However, what happens if the client does it’s step using the ‘wrong’ image. If 3) is to hold it should not be possible for the server to compute the key.

Client computes:

  M_sc = M_s . S_c

  M_c = g. H(m’) . S_c
The clients final key share is: M_sc = g . H(m) . S_c . S_s

Now server computes: M_cs = M_c . S_s = g . H(m’) . S_c . S_s

The secret shares don’t match. But if the server knows H(m’) it can compute:

M_cs’ = M_cs . inv(H(m’)) . H(m)

and this secret share will match

Normally this client side list in PSI is just used to speed up the protocol so the server does not have to do a crypto operation for every element in its set. It is not a pre-commitment from the server.

Also, maybe the way I’m doing it here is just normally broken because it is not robust against low entropy inputs to the hash function.

I've also reversed some of apple's non-public crypto that is used in some of it's services and they have made dubious design decisions in the past they have created weird weaknesses. Without knowing exactly what they are doing I would not try and infer properties that might not exist or trust their implementation.

Re:Apple's child protection features spark concern within it... by OneLeggedCat on Friday August 13, 2021 @03:40PM (#28173576)
> just Winnie the Pooh memes

I think it's hilarious that one of the world' great nations would scan for exactly this.

Re:Apple's child protection features spark concern within it... by new_realist on Friday August 13, 2021 @12:31AM (#28165473)
Authoritarian governments have never needed preexisting technical gizmos in order to abuse their citizens. Look at what Russia and the Nazis did with no magic tech at all. Privacy stems from valuing human rights, not easily disproven lies about it being difficult to actually implement the spying.
Re:Apple's child protection features spark concern within it... by sharikone on Friday August 13, 2021 @03:49AM (#28166536)
True. You can have an authoritarian regime with little technology.

But what people are afraid of is how little it takes when the technology is there. And how Western governments seem to morph towards that. And how some bastions of freedom are falling

Re:Apple's child protection features spark concern within it... by vimacs2 on Friday August 13, 2021 @08:52AM (#28168244)
"easily disproven lies", what lies exactly?

Even a Jew stuck in a ghetto in Nazi Germany enjoyed significantly better privacy at home from both the state and capital than a wealthy citizen in a typical western liberal nation today.

Soviet Russia and Nazi Germany in fact prove the exact opposite of what point you think you're making. They were foremost in using the "magic tech" of their day - telecommunications and motorised vehicles.

Even then, they had several rebellions and uprisings that were able to develop thanks to lacking the degree of surveillance tech found today.

Re:Apple's child protection features spark concern within it... by kragen on Friday August 13, 2021 @12:46AM (#28165555)
On the contrary, the reason Stalin and Hitler could enact repressive measures unprecedented in human history was precisely new technological developments like the telephone, the battle tank, and IBM cards. Bad people will never value human rights; getting privacy from bad people requires you to make it actually difficult to implement the spying, rather than just lie about it. That's why the slogan says, "cypherpunks write code."
Re:Apple's child protection features spark concern within it... by Grustaf on Friday August 13, 2021 @02:57AM (#28166237)
No, they could enact repressive measures because they had almost absolute power. The form that oppression took would obviously rely on the then current technology, but the fundamental enabler of oppression was power, not technology.
Re:Apple's child protection features spark concern within it... by vimacs2 on Friday August 13, 2021 @08:42AM (#28168163)
Power which was extended through the use of said technology. I'm fine with focusing on regressive hierarchical systems as the fundamental root of oppression but pretending like the information and mechanical technology introduced in the late 19th century to early 20th century did not massively increase the reach of the state is just being ridiculous.

Prior to motorised vehicles and the telegraph for example, borders were almost impossible to enforce on the general population without significant leakage.

Ironically in spite of powered flight, freedom of movement is in a sense significantly less than even 200 years ago when it comes to movement between countries that do not already have diplomatic ties to one another allowing for state authorized travel.

Incidentally, this is part of why many punishments in the medieval age were so extreme - the actual ability of the state to enforce the law was so pathetically limited by today's standards that they needed a strong element of fear to attempt to control the population.

Re:Apple's child protection features spark concern within it... by kmeisthax on Friday August 13, 2021 @12:15PM (#28170842)
There's a flipside to this, too: technology doesn't just improve the ability of the state to enforce law (or social mores), it also improves the ability of it's subjects to violate it with impunity.

Borders in medieval Europe weren't nearly as necessary because the physical ability to travel was limited. Forget traveling from Germany to France - just going to the next town over was a life-threatening affair without assistance and wealth. Legally speaking, most peasant farmers were property of their lord's manor. But practically speaking, leaving the manor would be quite difficult on your own.

Many churches railed against motor vehicles because the extra freedom of movement they made possible also broke sexual mores - someone might use that car to engage in prostitution! You see similar arguments made today about birth control or abortion.

Prior to the Internet, American mass communication was effectively censored by the government under a series of legally odd excuses about public interest in efficiently-allocated spectrum. In other words, this was a technical limitation of radio, weaponized to make an end-run around the 1st Amendment. Getting rid of that technical limitation increased freedom. Even today, getting banned from Facebook for spouting too much right-wing nonsense isn't as censorious as, say, the FCC fining you millions of dollars for an accidental swear word.

Whether or not a technology actually winds up increasing or reducing freedom depends more on how it's distributed than on just how much of it there is. Technology doesn't care one way or the other about your freedom. However, freedom is intimately tied to another thing: equity. Systems that economically franchise their subjects, have low inequality, and keep their hierarchies in check, will see the "technology dividend" of increased freedom go to their subjects. Systems that impoverish people, have high inequality, and let their hierarchies grow without bound, will instead squander that dividend for themselves.

This is a feedback effect, too. Most technology is invented in systems with freedom and equality, and then that technology goes on to reinforce those freedoms. Unequal systems squander their subjects' ability to invent new technologies. We didn't see this with Nazi Germany, because the Allies wiped them off the map too quickly; but the Soviet Union lost their technological edge over time. The political hierarchy they had established to replace the prior capitalist one made technological innovation impractical. So, the more you use technology to restrict, censor, or oppress people, the more likely that your country falls behind economically and stagnates. The elites at the top of any hierarchical system - aside from the harshest dictatorships - absolutely do not want that happening.

Re:Apple's child protection features spark concern within it... by vimacs2 on Saturday August 14, 2021 @08:54AM (#28180241)
A lot of excellent points though it's completely inaccurate to frame the fall of the Soviet Union's scientific progress due to their hierarchy replacing the "prior capitalist one" when the former lead to the mass industrialisation and rapid economic growth that lead to the USSR being the first nation to conquer space flight whereas under the latter, the USSR was an agrarian society suffering from food shortages and mass poverty. The decline of Soviet science and economy had more to do with NATO and American restrictions on trade and movement than something self imposed by the Soviets.

Capitalism is completely compatible with hierarchies and censorship - indeed one could argue that capitalism is completely incompatible with a true flattening of hierarchies since it rests on the ability of an owner class holding a monopoly over the means of production. The majority of dictatorships around the world use capitalism as the basis of it's economy. Following the dissolving of the USSR, Russia continues to be authoritarian and arguably more so than the USSR was past the Stalin era.

Aside from that, I think it's a little premature to frame the internet's ultimate effect on the world as reducing the ability of the government to censor the population when it's only been around for less than 30 years and we are already seeing mass adoption and development of both censorship and surveillance tech that goes beyond even the wildest dreams of 20th century era dictators.

I don't really buy the argument that most technology is invented in systems with freedom and equality either. It just sounds more like something we want to believe than something borne out by data. The internet and rocket ships were the product of the military - an institution that has more to do with using force to enact the will of it's host nation on others and limiting their freedoms than preserving the freedoms of their own, especially for superpowers like the USA and the CCP, which are effectively immune to conquest by military force.

This is in fact the same for the Silicon Valley and most private industry, you only think all this tech is the product of your freedom and equality because all of the actual extreme inequality and lack of freedom is kept compartmentalised to the global south through long and convoluted supply chains. It's not really freedom if only 10% of the actual people involved in the sustaining of an economy have any semblance of it -leaving aside the observation that for even this 10% that represents the average US citizen, their actual democratic agency in the state or in their job is vanishingly low.

Re:Apple's child protection features spark concern within it... by kragen on Friday August 27, 2021 @02:08AM (#28324781)
While there's some good food for thought in here, I want to quibble with a couple of things.

First, the Soviet Union didn't have a prior capitalist hierarchy; the whole reason for Leninism as such was that Russia was a feudal, agrarian society, which in Marx's theory had not progressed to the stage of capitalism and therefore could not progress to communism.

Second, food shortages and mass poverty did not end with the establishment of the Soviet Union; in fact, they became enormously worse. Even before being invaded by Germany in WWII, the Soviet system caused the Holodomor, a famine unprecedented in the history of the Ukraine.

Third, the internet has been around for 52 years, not less than 30. I've personally been using it for 29 years, and I can tell you that it already had a long history when I started using it. One of the founders of Y Combinator first became well-known as a result of breaking significant parts of the internet 33 years ago, an event which resulted in a criminal trial.

Fourth, the internet was the product of universities, although the universities were funded by ARPA. Rocket ships have a long evolution including not only militaries but also recreational fireworks, Tipu Sultan of Mysore, Tsiolkovsky, Goddard, the peaceful space agencies, H. G. Wells, and possibly Lagâri Hasan Çelebi.

Fifth, I don't think the argument is that the technology is necessarily produced by systems with freedom and equality, but that it is invented by them. This is somewhat dubious, but not as open-and-shut wrong as your misunderstanding of it. Goddard's rockets were put into mass production as the V2 in Nazi Germany using slave labor, but he invented them at WPI and Princeton. Tsiolkovsky lived in the Czar's Russia and then the USSR, and his daughter was arrested by the Czar's secret police, but he himself seems to have had considerable freedom to experiment with dirigibles and publish his research (but no slaves to build rockets for him), and indeed he was elected to the Socialist Academy.

I think we can make an excellent case that certain kinds of intellectual repression, whether grassroots or hierarchical, fall very heavily on the kinds of people who tend to invent things. William Kamkwamba's family thought he was insane, Galileo spent the last years of his life under house arrest, Newton was doing alchemical research that could have gotten him burned at the stake in Spain, Qin Shi Huang buried the Mohists alive, Giordano Bruno was in fact burned at the stake, and the repression of Lysenko's intellectual opposition was a major reason for the USSR's and PRC's economic troubles in the 01950s and 01960s.

Living in the so-called "global south" (a term which I have come to regard as useless for understanding the world system, if not actively counterproductive) I have to tell you that there's very little production of advanced technology going on here. But I live in Argentina, and the situation is different in different countries; Indonesia, Thailand, Vietnam, etc., have all done significant technical production for the world economy while in the grip of dictatorships, even though Argentina never has. But most countries don't. If tantalum cost ten times as much, we'd still have cellphones, and you probably wouldn't even be able to detect the price difference.

Re:Apple's child protection features spark concern within it... by wizzwizz4 on Friday August 13, 2021 @07:18AM (#28167623)
> but the fundamental enabler of oppression was power, not technology.

But bad people will always have power.

Re:Apple's child protection features spark concern within it... by Razengan on Friday August 13, 2021 @03:33AM (#28166446)
> Look at what Russia and the Nazis did

Something strikes me as odd; Why do you say “Russia” but not “Germany”? Why not say “Soviets” or something similar?

Is it because Russia is still portrayed as the bogeyman in the Anglosphere whereas the Germans are cool now?

Re:Apple's child protection features spark concern within it... by kelnos on Friday August 13, 2021 @02:08AM (#28165967)
There's a difference -- often a big one -- between being theoretically able to build some feature into a phone (plus the server-side infra and staffing to support it), and actually having built it. That's the capability angle.

However, the difference between having a feature enabled based on the value of a seemingly-unrelated user-controlled setting, versus having that feature enabled all the time... is basically zero. Additionally, extending this feature to encompass other kinds of content is a matter of data entry, not engineering. That's the policy angle.

When you don't yet have a capability, it might take a lot of work and commitment to develop it. But on the contrary, policy can be changed with the flip of a switch.

Re:Apple's child protection features spark concern within it... by Dylan16807 on Thursday August 12, 2021 @09:36PM (#28164271)
Making a custom OS update is pretty different from adding an entry into a database, and could also be mitigated against.
Re:Apple's child protection features spark concern within it... by js2 on Thursday August 12, 2021 @09:26PM (#28164209)
Yes, of course that is true. I use iCloud Photos and find this terribly creepy. If Apple must scan my photos, I'd rather they do it on their servers.

I could maybe understand the new implementation if Apple had announced they'd also be enabling E2E encryption of everything in iCloud, and explained it as "this is the only way we can prevent CSAM from being stored on our servers."

Re:Apple's child protection features spark concern within it... by AnthonyMouse on Thursday August 12, 2021 @10:39PM (#28164734)
> "this is the only way we can prevent CSAM from being stored on our servers."

Why is that supposed to be their responsibility?

Given the scale of their business, there is effectively a certainty that people are transmitting CSAM via Comcast's network. That's no excuse for them to ban end to end encryption or start pushing out code to scan client devices.

When you hail a taxi, they don't search you for drugs before letting you inside.

Because they're not the police. It isn't their role to enforce the law.

Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:40AM (#28165808)
Why is that supposed to be their responsibility?

They (and Google, Microsoft, Facebook, etc.) are essentially mandated reporters; if CSAM is on their servers, they're required to report it.

It's like how a doctor is a mandated reporter regarding physical abuse and other issues.

Because they're not the police. It isn't their role to enforce the law.

They're not enforcing the law; if the CSAM reaches a certain threshold, they check it out and if it's the real deal, they report to National Center for Missing and Exploited Children (NCMEC); they get law enforcement involved if necessary.

Re:Apple's child protection features spark concern within it... by kelnos on Friday August 13, 2021 @02:16AM (#28166015)
> They (and Google, Microsoft, Facebook, etc.) are essentially mandated reporters; if CSAM is on their servers, they're required to report it.

I don't think that's correct. My understanding is that if they find CSAM, they're obligated to report it (just like anyone is). I don't believe they are legally obligated to proactively look for it. (It would be a PR nightmare for them to have an unchecked CSAM problem on their services, so they do look for it and report it.)

Consider that Apple likely does have CSAM on their servers, because they apparently don't scan iCloud backups right now. I don't believe they're breaking any laws, at least until and unless they find any of it and (hypothetically) don't report it

Re:Apple's child protection features spark concern within it... by kmeisthax on Friday August 13, 2021 @12:40PM (#28171228)
Last year Congress mulled over a bill (EARN IT Act) that would explicitly require online services to proactively search for CSAM, by allowing services to be sued by governments for failing to do so. It would also allow services to be sued for failing to provide law-enforcement back doors to encrypted data. There's also SESTA/FOSTA, already in law, that rescinded CDA 230 protection for cases involving sex trafficking.

Quite honestly, my opinion is that any service not scanning for CSAM is living on borrowed time.

Re:Apple's child protection features spark concern within it... by emodendroket on Thursday August 12, 2021 @11:14PM (#28164986)
If you become known as a hub for this stuff Congress probably won't see it that way.
Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:32AM (#28165768)
If Apple must scan my photos, I'd rather they do it on their servers.

Scanning on their servers is much less privacy preserving for users but don't fret, Dropbox, Facebook, Microsoft, etc. already scan stored photos.

Re:Apple's child protection features spark concern within it... by lifty on Friday August 13, 2021 @07:25AM (#28167657)
Not necessarily. The scanning implementation can be similar to what they plan on doing on your device. I don't want them to do the scanning on my phone. If shit hits the fan and I become a dissident, I would prefer to have the option to stop using iCloud, Dropbox or any other service that might enable my government or the secret police to suppress me.
Re:Apple's child protection features spark concern within it... by zekrioca on Sunday August 15, 2021 @02:26AM (#28186642)
One can encrypt a picture before uploading it to the aforementioned services, and as such nothing would really happen. That’s not a possibility on pictures taken on iPhones that get uploaded to iCloud.
Re:Apple's child protection features spark concern within it... by callmeal on Thursday August 12, 2021 @09:08PM (#28164057)
>As currently implemented, iOS will only scan photos to be uploaded to iCloud Photos. If iCloud Photos is not enabled, then Apple isn't scanning the phone.

Except for the "oops, due to an unexpected bug in our code, every image, document, and message on your device was being continuously scanned" mea culpa we will see a few months after this goes live.

Re:Apple's child protection features spark concern within it... by hypothesis on Friday August 13, 2021 @12:48AM (#28165569)
Apple can’t even keep settings values correctly.

After they introduced AirTags I went and disabled item detection on all my devices. Yesterday I went into settings and guess what, that feature is enabled again. On all my devices! I’m not sure when that happened, but my guess would be that latest iOS update caused that…

My point is, you will only have things working to the extent you have testing for, and test coverage is likely less robust for less popular features or where perception tells developers that “no one is going turn that mega-feature off”.

Re:Apple's child protection features spark concern within it... by jq-r on Friday August 13, 2021 @05:42AM (#28167089)
Just like the facebook and it's Messenger application "forget" that you had your in-app sounds turned off and turns it off now and then.
Re:Apple's child protection features spark concern within it... by m4rtink on Friday August 13, 2021 @06:56AM (#28167482)
Well its an unauditable locked down proprietary black box.
Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:49AM (#28165854)
Except for the "oops, due to an unexpected bug in our code, every image, document, and message on your device was being continuously scanned" mea culpa we will see a few months after this goes live.

Only images that match the hashes of the database of CSAM held by the National Center for Missing and Exploited Children (NCMEC) that are uploaded to iCloud Photos are checked.

Based on their technical documents, it's not even possible for anything else to be checked; even if they could, they learn nothing from documents that aren't CSAM.

Re:Apple's child protection features spark concern within it... by noduerme on Friday August 13, 2021 @04:26AM (#28166724)
>>> Only images that match the hashes of the database of CSAM held by the National Center for Missing and Exploited Children (NCMEC) that are uploaded to iCloud Photos are checked.

Incorrect. All files on the phone will be checked against a hash database before being uploaded to iCloud. Any time before, which means all the time, if you have iCloud enabled.

Re:Apple's child protection features spark concern within it... by alwillis on Saturday August 14, 2021 @02:16AM (#28178492)
All files on the phone will be checked against a hash database before being uploaded to iCloud.

A cryptographic safety voucher is created for each photo as they're uploaded. The iPhone doesn't know wether or not anything matched. Nothing happens unless the user reaches a threshold of 30 CSAM images that have been uploaded to iCloud Photos.

Re:Apple's child protection features spark concern within it... by noduerme on Tuesday August 17, 2021 @04:44AM (#28207600)
The phone also doesn't know whether something is about to be uploaded or not. Therefore, all files on the phone will be checked is the relevant portion of that sentence.
Re:Apple's child protection features spark concern within it... by pseudalopex on Friday August 13, 2021 @09:52AM (#28168826)
Nothing limits Apple to shipping just the hashes provided by NCMEC. And people who worked with NCMEC's database say it contains documents that aren't CSAM.
Re:Apple's child protection features spark concern within it... by resfirestar on Thursday August 12, 2021 @09:30PM (#28164229)
The potential for this is overblown and I think a lot of people haven’t taken the time to understand how the system is set up. iOS is not scanning for hash matches and phoning home every time it sees one, it’s attaching a cryptographic voucher to every photo uploaded to iCloud that, if some number of photos represent hash matches (the fact of the match is not revealed until the threshold number is reached), then allow Apple to decrypt the photos that match. This is not something where “oops bug got non-iCloud photos too” or “court told us to flip the switch to scan the other photos” would make any sense, some significant modification would be required. Which I agree is a risk especially with governments like China/EU that like to set conditions for market access, just not a very immediate one.
Re:Apple's child protection features spark concern within it... by spsful on Thursday August 12, 2021 @10:37PM (#28164714)
I hear you, 100%, but as a longtime Apple and iCloud user I have been through the absolute ringer when it comes to iCloud and have little faith in it operating correctly.

1. About 3 years ago, there were empty files taking up storage on my iCloud account, and they weren't visible on the website so I couldn't delete them. All it showed was that an excessive amount of storage was taken up. Apple advisors had no idea what was going on and my entire account had to be sent to iCloud engineers to resolve the issue. They never followed up, but it took months for these random ghost files to stop taking up my iCloud storage.

2. Sometimes flipping them on and off a lot causes delays in the OS and then you have to kill the Settings app and re open it to see if they're actually enabled. Back when ATT was just being implemented, I noticed it was grayed out on my phone every time I was signed in to iCloud, but was completely operational when I was signed out. Many others had this issue and there was literally no setting to change within iCloud; it was a bug that engineering literally acknowledged to me in an email (they acknowledged that it happened for some users and fixed it in a software update).

Screwups happen in an increasingly complex OS and I just feel that there will be a day when this type of bug surfaces in addition to everything that already happens to us end users.

Re:Apple's child protection features spark concern within it... by kazoomonger on Friday August 13, 2021 @12:10AM (#28165349)
> it’s attaching a cryptographic voucher to every photo uploaded to iCloud that, if some number of photos represent hash matches

OK, but what if Apple silently pushes out an update (or has existing code that gets activated) that "accidentally" sets that number to zero? Or otherwise targets a cryptographic weakness that they know about because they engineered it? That wouldn't require "significant modification".

Funamentally, it's closed software and hardware. You can't and shouldn't trust it. Even if they did do some "significant modification" how are you going to notice/prove it?

Re:Apple's child protection features spark concern within it... by FireBeyond on Friday August 13, 2021 @01:07PM (#28171609)
> it’s attaching a cryptographic voucher to every photo uploaded to iCloud that, if some number of photos represent hash matches

I see this number very quickly getting set to '1', because the spin in the opposite direction is "What, so you're saying, people get X freebies of CSAM that they can store in iCloud that Apple will never tell anybody about?"

_That_ is a whole other PR disaster.

Re:Apple's child protection features spark concern within it... by whoisjuan on Thursday August 12, 2021 @09:08PM (#28164062)
That’s wrong. They are also enabling on-device detection for Messages.
Re:Apple's child protection features spark concern within it... by js2 on Thursday August 12, 2021 @09:15PM (#28164116)
Communication safety in Messages is a different feature than CSAM detection in iCloud Photos. The two features are not the same and do not use the same technology. In addition:

Communication safety in Messages is only available for accounts set up as families in iCloud. Parent/guardian accounts must opt in to turn on the feature for their family group. Parental notifications can only be enabled by parents/guardians for child accounts age 12 or younger.

https://www.apple.com/child-safety/pdf/Expanded_Protections_...

Re:Apple's child protection features spark concern within it... by b0tzzzzzzman on Thursday August 12, 2021 @10:36PM (#28164709)
Yeah, for now this is what is stated. It should be alarming how much they pivoted and changed with out any background statment. Something more is at play.
Re:Apple's child protection features spark concern within it... by m4rtink on Friday August 13, 2021 @07:02AM (#28167520)
Thats the thing - with an unauditable black box like iOS you have to trust the vendor that it actually does what they say.

If they suddenly start to break you trust - who knows what they will push to that black box next time ? You have no way to tell or prevent that, other than leaving the whole platform altogether.

Re:Apple's child protection features spark concern within it... by tremon on Friday August 13, 2021 @09:44AM (#28168742)
> As currently implemented

We don't actually know what is implemented. We only know what Apple's PR machine is saying about it, or do we have the source code somewhere?

Re:Apple's child protection features spark concern within it... by browningstreet on Thursday August 12, 2021 @11:34PM (#28165090)
For now, in v1.
Re:Apple's child protection features spark concern within it... by raxxorrax on Friday August 13, 2021 @02:29AM (#28166090)
They are not E2E encrypted if they are decryptable. We should use the correct terminology here, especially to not subject users to false security.
Re:Apple's child protection features spark concern within it... by shbooms on Friday August 13, 2021 @08:24AM (#28168024)
>iMessages are already E2E encrypted, but you are correct, iCloud backups are decryptable with a warrant (and that was reportedly added at the FBI's request).

Not to be nit-picky but IIRC, this isn't exactly how it went down. icloud backups have always been decryptable and Apple had announced they were planning on changing this and making them fully encrypted but when pressured by the FBI, they scraped those plans and left them the way they are.

Re:Apple's child protection features spark concern within it... by sillysaurusx on Friday August 13, 2021 @02:52AM (#28166211)
> But with Apple's CSAM proposal is NOT possible to have an iPhone that Apple isn't continuously scanning.

This is mistaken. If you turn off iCloud sync, Apple isn't continuously scanning your phone.

Re:Apple's child protection features spark concern within it... by websites2023 on Friday August 13, 2021 @02:55PM (#28172880)
> But with Apple's CSAM proposal is NOT possible to have an iPhone that Apple isn't continuously scanning

This is not accurate. Scanning doesn’t happen without iCloud photos enabled.

Re:Apple's child protection features spark concern within it... by dmix on Thursday August 12, 2021 @10:38PM (#28164724)
iMessage isnt true E2E encryption. Apple could easily decode messages for a 3rd party if they wanted to. This has been widely discussed on HN previously. All they have to do is insert an additional private key in the two party chat, as the connection is ultimately handled centrally.

There's a very good reason Signal (and previously Whatsapp) were recommended over iMessage.

Not to mention the inability to swap iMessage off for SMS which has made it a favourite exploit target for hacking firms like NSO.

Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:52AM (#28165872)
Apple could easily decode messages for a 3rd party if they wanted to.

They don't have the keys, so how exactly would they decrypt these messages?

Re:Apple's child protection features spark concern within it... by dmix on Friday August 13, 2021 @01:53AM (#28165884)
They would be able to decrypt messages after the point of interception, not retroactively.
Re:Apple's child protection features spark concern within it... by jakemauer on Friday August 13, 2021 @12:45AM (#28165547)
You can turn off iMessages and force the phone to use SMS, however you can't do it on a per-contact or per-conversation basis.
Re:Apple's child protection features spark concern within it... by pyuser583 on Saturday August 14, 2021 @11:56PM (#28186146)
iPhones are already continuously scanning your photos. Every notice how it recognizes faces and organizes your photos by them?

You can’t turn that off!!

There’s no way to tell the iPhone, “stop with the AI recognition on my photos.”

Since Apple has decided it’s going to categorize all your photos based on AI, it was just a matter of time before they started categorizing some bad stuff.

Re:Apple's child protection features spark concern within it... by trauco on Friday August 13, 2021 @10:56AM (#28169644)
"iMessages are already E2E encrypted,"

Unless you use iCloud Backup for iMessage, in which case Apple holds the keys to decrypt them.

Re:Apple's child protection features spark concern within it... by alwillis on Friday August 13, 2021 @01:24AM (#28165741)
But with Apple's CSAM proposal is NOT possible to have an iPhone that Apple isn't continuously scanning.

Sure it is—just don't use iCloud Photos. They've been quite clear about this.

Re:Apple's child protection features spark concern within it... by sneak on Friday August 13, 2021 @02:44AM (#28166171)
iCloud Backup is a backdoor in the iMessage e2e, and Apple can decrypt all the iMessages. No warrant is required for Apple to do so.

Even with iCloud off, the other endpoint (the phones you're iMessaging with) will be leaking your conversations to Apple because they will still have iCloud Backup defaulted to on.

iMessage is no longer an e2e messenger, and Apple intentionally preserves this backdoor for the FBI and IC.

They access 30,000+ users' data per year without warrants.