News for hackers. Stuff that matters.
Re:Apple's child protection features spark concern within it... by jonplackett on Thursday August 12, 2021 @06:41PM (#28162537)
In their attempt to make this extra private by scanning 'on device', I think they've managed to make it feel worse.

If they scan my iCloud photos in iCloud, well lots of companies scan stuff when you upload it. It's on their servers, they're responsible for it. They don't want to be hosting CSAM.

It feels much worse them turning your own, trusty iPhone against you.

I know that isn't how you should look at it, but that's still how it feels.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @06:57PM (#28162712)
The practical difference is that with on-device scanning, the system is just a few bit flips away from scanning every photo on your device, instead of just the ones that are about to be uploaded. With server-side scanning, the separation is clear—what's on Apple's server can be scanned, and what's only on your phone cannot.

This all plays so perfectly into my long-time fears about the locked down nature of the iPhone. Sure, it's more secure if Apple is a good steward, but no one outside of Apple can inspect or audit what it's doing!

Re:Apple's child protection features spark concern within it... by nitrogen on Thursday August 12, 2021 @07:56PM (#28163393)
With server-side scanning, the separation is clear

In all these threads everyone is coming close to the crux of the issue, but I want to restate it in clearer terms:

There is a sacrosanct line between "public" and "private," "mine" and "yours." That line cannot be crossed by Western governments without a warrant. Cloud computing has deliberately blurred this line over time. This on-device scanning implementation blows right past that line.

Our tools before the computing revolution, and our devices after, become a part of us. Our proprioception extends to include them as part of "self." A personal device -- a tool that should be wholly owned and wholly dependable, like pen and paper -- that betrays its user, is a self that betrays itself.

Re:Apple's child protection features spark concern within it... by inkyoto on Thursday August 12, 2021 @08:25PM (#28163681)
> There is a sacrosanct line between "public" and "private," "mine" and "yours." That line cannot be crossed by Western governments without a warrant.

This is a self-delusion, I am afraid. The line has been crossed more than once, and it will be crossed again. UK and Australian governments are just two prime examples of waving terrorism and pedobear banners as a pretext to get invasive with each new legislation, and the Oz government already has a new legislation draft to make it a crime to refuse cooperation with law enforcing services when they request access to the encrypted content (think Signal messages). Also, refer to the Witness K case to see how cases that are unfavourable to the standing government completely bypass a «trustworthy» Western judicial system, including the Minister of Justice.

CSAM is guaranteed to be abused under whatever new pretext politicians can come up with, and we won't even know that Apple has been quietly subjugated to comply with it in those jurisdictions. There will be even less transparency and even more abuse of CSAM in «non-Western» countries. That is the actual worry.

Re:Apple's child protection features spark concern within it... by joe_the_user on Thursday August 12, 2021 @11:20PM (#28165015)
The line between private and public has been crossed many times but we're still better off having that line officially there.

Even if the cops and private security along with TLAs are actively spying on people on an extremely regular basis, we're better off if officially they aren't supposed to be, if some court cases can get tossed for this, that they have to retreat sometimes, etc.

This is why having Apple overtly spying on the "private side" is still a big thing even with all the other revelations.

Re:Apple's child protection features spark concern within it... by feanaro on Friday August 13, 2021 @02:39AM (#28166140)
The line is not a delusion just because it happened to be crossed at some point. The line is there because humans intuitively consider it to be there.

The fact that the line is there gives us a reason and a foothold to fight back when someone attempts crossing it.

Re:Apple's child protection features spark concern within it... by mlindner on Friday August 13, 2021 @03:16AM (#28166356)
In the US however this division remains, even if it has been lost elsewhere. (This loss is one of the reasons I have had to never want to live in the UK nor Australia.)
Re:Apple's child protection features spark concern within it... by adolph on Thursday August 12, 2021 @08:54PM (#28163925)
And all the while:

Sir James Wilson Vincent Savile OBE KCSG (/ˈsævɪl/; 31 October 1926 – 29 October 2011) was an English DJ, television and radio personality who hosted BBC shows including Top of the Pops and Jim'll Fix It. He raised an estimated £40 million for charities and, during his lifetime, was widely praised for his personal qualities and as a fund-raiser. After his death, hundreds of allegations of sexual abuse were made against him, leading the police to conclude that Savile had been a predatory sex offender—possibly one of Britain's most prolific. There had been allegations during his lifetime, but they were dismissed and accusers ignored or disbelieved; Savile took legal action against some accusers.

https://en.wikipedia.org/wiki/Jimmy_Savile

Re:Apple's child protection features spark concern within it... by dmix on Thursday August 12, 2021 @10:43PM (#28164769)
There's never been any indication that there has been any more difficulty in catching these guys with better smartphone privacy features. It's easier than ever largely because the police have become better at investigations involving the internet.

Asking the police to put some investigative effort in rather than a dragnet sweep of every photo on every persons device is not too much to ask.

Importantly this should be the hard-capped precedent for every sort of crime. There's always a ton of other ways these people get caught without handing over preemptive access to every innocent persons phone. Same with terrorism, murder, etc.

Re:Apple's child protection features spark concern within it... by adolph on Thursday August 12, 2021 @11:53PM (#28165232)
Maybe I should add more text in support of the parent comment's point. When I read "UK and Australian governments are just two prime examples of waving terrorism and pedobear banners," my first thought was: all the while _protecting_ monsters like Savile.

I see push for CSAM as an alignment of powers in the form of "The Baptist and Bootlegger." The well meaning moral campaigners are a tool for folks who seek to surveil and control.

https://en.wikipedia.org/wiki/Bootleggers_and_Baptists

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @09:00PM (#28163978)
Respectfully, I don't understand where you're going with this at all. I could point to it and say, "Wow, we need to make sure nothing like that ever happens again, no matter what the cost to personal liberty!"
Re:Apple's child protection features spark concern within it... by adolph on Friday August 13, 2021 @12:08AM (#28165330)
I can see that interpretation for sure. My impression is that folks like Savile will always be protected from CSAM by the same powers that be calling for CSAM. I'm not certain if that viewpoint is realism or cynicism, or if there is a difference.
Re:Apple's child protection features spark concern within it... by N00bN00b on Thursday August 12, 2021 @08:14PM (#28163576)
> that betrays its user, is a self that betrays itself.

And cloud computing are corporations that take your self away from you.

And that was always going to happen. And people have been fighting that idea in the shadows for a while.

This issue is just bringing it to the foreground in a most intense way. "Think of the children."

They are coming for your self. They will take it. There's not doubt. There never was. Your self is too valuable and you've just been squandering it anyway.

Eventually you become Apple. Unless you start resisting, but that's hard. Just slooooowly warm the water. This froggy is fine. Nice and warm. Just don't touch the bottom of the pot.

Re:Apple's child protection features spark concern within it... by FooHentai on Thursday August 12, 2021 @07:53PM (#28163365)
>the system is just a few bit flips away from scanning every photo on your device

I prefer to think of it as being just one national security letter away from that happening.

Which is of course a schroedinger's cat kinda thing. It's already been sent. Or it hasn't. But why would the national security apparatus not take advantage of this obvious opportunity?

Anyone giving benefit of the doubt to this kind of stuff nowadays is IMO very naive or just poorly informed of recent digital history.

Re:Apple's child protection features spark concern within it... by jdavis703 on Thursday August 12, 2021 @08:16PM (#28163585)
How would the agency issuing an NSL be able to generate a hash of a photo they’re looking for? Presumably if they already had a photo to derive the hash they’d already have whatever it is they’re searching for.
Re:Apple's child protection features spark concern within it... by gpm on Thursday August 12, 2021 @08:30PM (#28163731)
Because you're searching for people, not documents.

For a normal law enforcement context, say you bust 1 drug dealer, and are trying to find more. Maybe they have an image of a "contract" (document outlining terms of a drug deal) on their phone. You could find the other parties to that contract by searching everyone's phones for that image.

For a national security context, you could imagine equivalents to the above, you could also imagine searching for classified documents that are believed to have been leaked, or maybe searching for documents you stole from an adversary that you believe there spies are likely to be storing on their phones.

I'm saying documents here instead of images, but plenty of documents are just images, and I have little doubt that they could get this program to expand to include "scan PDFs, because you could make a CSAM into a pdf" (if it doesn't already?).

Re:Apple's child protection features spark concern within it... by silverpepsi on Thursday August 12, 2021 @08:56PM (#28163943)
I think you already got one great reply, I have just one thing to add to it: your post literally presupposes a 1.0 version of this software that never has its feature set expanded. I don't think that's a reasonable assumption. After all, with 1.0 the goal of catching this class of person is barely achieved. They'll likely arrest people, 99% of whom are just CSAM jpeg collectors who get an extra kick out of viewing a class of image that is super illegal. And nothing more.

Then for version 2.0, they'll realize the INTERPOL, FBI, whatever can provide them a combo hash plus one string of text that can nail a known active producer. The holy grail. This small feature add to get so much closer to the original "moral goal" will prove too appealing to pass up. Now all the code is in place for the govt to pass over requests for data pinpointing mere common criminals.

Re:Apple's child protection features spark concern within it... by barsonme on Thursday August 12, 2021 @09:13PM (#28164105)
It’s fuzzy hashing, so they don’t need the bit-for-bit same image.

Outside the US and other western countries, this could be a government (Russia? Chechnya?) forcing Apple to look for LGBT pride flags.

Re:Apple's child protection features spark concern within it... by unionpivo on Friday August 13, 2021 @01:41AM (#28165811)
The program has capability to upload questionable photos for review.

Just make it do equivalent of .* of all photos on device. It would be hard to argue, that's more difficult than scanning for specific hash.

And there is nothing specific about images. Extending this to scan arbitrary data is probably not that much code, depending on how its program maybe configurable.

Re:Apple's child protection features spark concern within it... by throaway46546 on Thursday August 12, 2021 @07:44PM (#28163256)
I agree. Our phones tend to hold all of our most intimate data. Violating them is akin to violating our homes. It would be nice if the laws saw it this way.
Re:Apple's child protection features spark concern within it... by tmdg on Thursday August 12, 2021 @07:04PM (#28162800)
I feel like this is a false sense of security. Even before this change, they can easily access and scan photos on your device. If they do any post-processing of the image on device, they already do.
Re:Apple's child protection features spark concern within it... by lifty on Thursday August 12, 2021 @07:14PM (#28162914)
It’s not a false sense of security, it’s a clear delimitation between theirs and mine; Debian package maintainers can also slip a scanner on your machine but that is a big line to cross on purpose and without notifying the user.
Re:Apple's child protection features spark concern within it... by totetsu on Thursday August 12, 2021 @07:42PM (#28163226)
But with a debian package you can choose not to accept the upgrade and see any funny business in the release source code..
Re:Apple's child protection features spark concern within it... by least on Thursday August 12, 2021 @07:50PM (#28163323)
That is technically true but in a real very practical sense everyone here using OSS absolutely is trusting a third party because they are not auditing every bit of code they run. For less technical people there is effectively zero difference between open and closed software.

It’s really disingenuous to suggest that open source isn’t dependent on trust, you just change who you are trusting. Even if the case is someone else is auditing that code, you’re trusting that person instead of the repository owners.

I’ll concede that at least that possibility to audit exists but personally I do have to trust to a certain extent that third parties aren’t trying to fuck me over.

Re:Apple's child protection features spark concern within it... by jancsika on Thursday August 12, 2021 @09:04PM (#28164006)
> Even if the case is someone else is auditing that code, you’re trusting that person instead of the repository owners.

Suppose Debian's dev process happened at monthly in-person meetings where minutes were taken and a new snapshot of the OS (without any specific attribution) released.

If that were the case, I'd rankly speculate that Debian devs would have misrepresented what happened in the openssl debacle. A claim would have been made that some openssl dev was present and signed off on the change. That dev would have then made a counterclaim that regular procedure wasn't followed, to which another dev would claim it was the openssl representative's responsibility to call for a review of relevant changes in the breakout session of day three before the second vote for the fourth day's schedule of changes to be finalized.

Instead, there is a very public history of events that led up to the debacle that anyone can consult. That distinction is important-- it means that once trust is in question, anyone-- including me-- can pile on and view a museum of the debacle to determine exactly how awful Debian's policy was wrt security-related changes.

There is no such museum for proprietary software, and that is a big deal.

Re:Apple's child protection features spark concern within it... by least on Thursday August 12, 2021 @09:18PM (#28164143)
That's certainly true, and it is a strong 'selling point,' so to speak, for open software. But openness is just one feature of many that people use for making considerations about the sort of software they run and frankly, for an average consumer, it probably weighs extremely low on their scale, because in either case it's effectively a black box, where having access to that information doesn't actually make them more informed, nor do they necessarily care to be informed.

Most people don't care to follow the controversies of tech unless it becomes a tremendously big issue, but even then, as we've seen here, there are plenty of people that simply don't have the technical acumen to really do any meaningful analysis of what's being presented to them and are depending on others to form their opinion, whether that be a friend/family member or some tech pundit writing an article on a major news organization's website.

Trusting Apple presents a risk to consumers but I'd argue that for many consumers, this has been a reasonable risk to take to date. This recent announcement is changing that risk factor significantly, though in the end it may still end up being a worthwhile one for a lot of people. Open Source isn't the be all end all solution to this, as great as that'd be.

Re:Apple's child protection features spark concern within it... by totetsu on Thursday August 12, 2021 @07:59PM (#28163428)
Thinking about this.. I guess my trust, is that someone smarter than I will notice it, cause a fuss, and the community will raise pitch forks and.. git forks. My trust is in the community, I hope it can stay healthy and diverse for all time.
Re:Apple's child protection features spark concern within it... by ipaddr on Thursday August 12, 2021 @08:34PM (#28163761)
Trusting in a group of people like you to cover areas you might not is the benefit of open source and a healthy community.

With Apple you have to trust them and trust they don't get national security order.

I trust that if everyone who had the ability to audit OSS got a national security order it would leak and it would be impossible for many who live in other nations.

Re:Apple's child protection features spark concern within it... by m4rtink on Friday August 13, 2021 @09:26AM (#28168552)
Maybe if you drink from the NPM PyPI firehouse without checking (as too many do unfortunately).

For regular Linux distribution there are maintainers updating packages from upstream source that can spot malicious changes slipped in upstream. And if maintainers in one district don't notice, it is likely some in onether distro will.

And there are LTS/enterprise distros where upstream changes take much longer to get in and the distro does not change much after release. Making it even less likely a sudden malicious change will get in unnoticed.

Re:Apple's child protection features spark concern within it... by gpm on Thursday August 12, 2021 @07:45PM (#28163265)
Somewhere along the line someone is producing and signing the binaries that find their way onto their computer, they could produce those binaries from different source code and I would be none the wiser.

Debian tries to be reproducible, so to avoid being caught they might need to control the mirror to so that they could send it to only me. I.e. if I'm lucky it would take a total of 2 people to put malicious binaries on my computer (1 with a signing key, 1 with access to the mirror I download things from).

Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:13PM (#28163560)
The only way what you said is not true for any networked device is to just go down to the river and throw it in and never use a digital device again. It's not a false sense of security, it's a calculated position on security and what you will accept, moving spying from the server to the phone was the last straw for a lot of people.
Re:Apple's child protection features spark concern within it... by shuckles on Thursday August 12, 2021 @07:10PM (#28162874)
Apple already scans your photos for faces and syncs found faces through iCloud. I’d imagine updating that machine learning model is at least as straightforward as this one.
Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @07:16PM (#28162946)
They're searching for different things though. To my knowledge, before now iOS has never scanned for fingerprints of specific photographs. It would be so darn easy to replace the CSAM database with fingerprints of known tiananmen square photos...
Re:Apple's child protection features spark concern within it... by shuckles on Thursday August 12, 2021 @07:23PM (#28163023)
That is a distinction without a difference. I’m sure you could put together quite a good tank man classifier (proof: Google Reverse Image Search works quite well), and it’d catch variations which a perceptual hash wouldn’t.

The only difference is intent. The technical risk has not changed at all.

Re:Apple's child protection features spark concern within it... by dpedu on Thursday August 12, 2021 @07:31PM (#28163106)
That is to say face scanning is equally insidious as the new feature?
Re:Apple's child protection features spark concern within it... by shuckles on Thursday August 12, 2021 @07:36PM (#28163162)
The technical risk to user privacy - if your threat model is a coerced Apple building surveillance features for nation state actors - is exactly the same between CSAM detection and Photos intelligence which sync results through iCloud. In fact, the latter is more generalizable, has no threshold protections, and so is likely worse.
Re:Apple's child protection features spark concern within it... by int_19h on Thursday August 12, 2021 @10:38PM (#28164727)
It's the legal risk that is the biggest problem here. Now that every politician out there knows that this can be done for child porn, there'll be plenty demanding the same for other stuff. And this puts Apple in a rather difficult position, since, with every such demand, they have to either accede, or explain why it's not "important enough" - which then is easily weaponized to bash them.

And not just Apple. Once technical feasibility is proven, I can easily see governments mandating this scheme for all devices sold. At that point, it can get even more ugly, since e.g. custom ROMs and such could be seen as a loophole, and cracked down upon.

Re:Apple's child protection features spark concern within it... by shuckles on Thursday August 12, 2021 @10:58PM (#28164897)
This hypothetical lacks an explanation for why every politician has not demanded Apple (or say Google) do this scope creep already for photos stored in the cloud where the technical feasibility and legal precedent has already been established by existing CSAM scanning solutions deployed at scale.
Re:Apple's child protection features spark concern within it... by int_19h on Thursday August 12, 2021 @11:07PM (#28164946)
I have to note that one of those solutions deployed at scale is Google's. But the big difference is that when those were originally rolled out, they didn't make quite that big of a splash, especially outside of tech circles.

I will also note that, while it may be a hypothetical in this particular instance as yet, EU already went from passing a law that allows companies to do something similar voluntarily (previously, they'd be running afoul of privacy regulations), to a proposed bill making it mandatory - in less than a year's time. I don't see why US would be any different in that regard.

Re:Apple's child protection features spark concern within it... by shuckles on Thursday August 12, 2021 @11:38PM (#28165116)
Ok but now you’ve said that the precedent established by Google and others already moved the legislation to require terrible invasions of privacy far along. You started by saying Apple’s technology (and, in particular, its framing of the technology) has brought new legal risk. What I’m instead hearing is the risk would be present in a counter factual world where nothing was announced last week.

At this point of the discussion, people usually pivot to scope creep: the on-device scanning could scan all your device data, instead of just the data you put on the cloud. This claim assumes that legislators are too dumb to connect the fact that if their phone can search for dogs with “on-device processing,” then it could also search for contraband. I doubt it. And even if they are, the national security apparatus will surely discover this argument for them, aided by the Andurils and NSOs of the world.

As I have repeatedly said: the reaction to this announcement sounds more like a collective reckoning of where we are as humans and not any particular new risk introduced by Apple. In the Apple vs. FBI letter, Tim urged us to have a discussion about encryption, when we want it, why we want it, and to what extent we should protect it. Instead, we elected Trump.

Re:Apple's child protection features spark concern within it... by int_19h on Friday August 13, 2021 @02:49AM (#28166197)
The precedent established by Google et al is that it's okay to scan things that are physically in their data centers. It's far from ideal, but at least it's somewhat common sense in that if you give your data to strangers, they can do unsavory things with it.

The precedent now established by Apple is that it's okay to scan things that are physically in possession of the user. Furthermore, they claim that they can do it without actually violating privacy (which is false, given that there's a manual verification step).

Re:Apple's child protection features spark concern within it... by shuckles on Friday August 13, 2021 @03:35AM (#28166456)
The precedent established by Apple, narrowly read, is it’s ok to scan data that the user is choosing to store in your data center. As you pointed out, this is at least partly a legal matter, and I’m sure their lawyers - the same ones who wrote their response in Apple vs. FBI I’d imagine - enumerated the scope or lack thereof.

Apple’s claim, further, is that this approach is more privacy-preserving than one which requires your cloud provider to run undisclosed algorithms on your plaintext photo library. They don’t say this is not “violating privacy,” nor would that be a well-defined claim without a lot of additional nuance.

Re:Apple's child protection features spark concern within it... by mlindner on Friday August 13, 2021 @03:21AM (#28166372)
Nonsense. Building an entire system as opposed to adding a single image to a database is a substantially different level of effort. In the US at least this was used successfully as a defense. The US cannot coerce companies build new things on their behalf because it would effectively create "forced speech" which is forbidden by the US Constitution. However they can be coerced if there is minimal effort like adding a single hash to a database.
Re:Apple's child protection features spark concern within it... by shuckles on Friday August 13, 2021 @03:43AM (#28166501)
Photos intelligence already exists, and if people are really going to cite the legal arguments in Apple vs. FBI, then it’s important to remember the “forced speech” Apple argued it could not be compelled to make was changing a rate limit constant on passcode retries.
Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @12:50AM (#28165576)
Exactly this. The whole thing is a red herring. If Apple wanted to go evil, they can easily do so, and this very complex CSAM mechanism is the last thing that will help them.
Re:Apple's child protection features spark concern within it... by shuckles on Friday August 13, 2021 @01:19AM (#28165719)
I’ve read your comments, and they are a glass of cold water in the hell of this discourse. This announcement should force people to think about how they are governed - to the extent they can influence it - and double down on Free Software alternatives to the vendor locked reality we live in.

Instead, a forum of presumably technically savvy people are reduced to hysterics over implausible futures and a letter to ask Apple to roll back a change that is barely different from, and arguably better than, the status quo.

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @01:05PM (#28171584)
Thanks. I couldn’t agree more.

We need both - develop free software alternatives (which means to stop pretending the alternatives are good enough), and to get real about supporting legal and governance principles that would protect against abuses.

If people want to do something about this, these are the only protections.

Re:Apple's child protection features spark concern within it... by samstave on Thursday August 12, 2021 @07:43PM (#28163245)
So you have User A - they upload a pic with User A and Peoples B,C,D,E,Z

icloud scans for those faces

finds those faces and ties them to other ID accounts via face - then via fingerprint recognition to a device, and to a location based on IMEI etc.

Apple's platform is literally the foundation for the most dystopian digital tool-set in history...

Once the government is able to crack the apple war chest, everything is fucked.

Re:Apple's child protection features spark concern within it... by fraa-orolo on Thursday August 12, 2021 @08:15PM (#28163583)
A false positive in matching faces results in a click to fix it or a wrongly categorized photo. A false positive in this new thing may land you in jail or have your life destroyed. Even an allegation of something so heinous is enough to ruin a life.

The "one in trillion" chance of false positives is Apple's invention. They haven't scanned trillions of photos and it's a guess. And you need multiple false positives, yet no one says how many, so it could be a low number. Either way, even with how small the chance of it being wrong is, the consequences for the individual are catastrophic. No one sane should accept that kind of risk/reward ratio.

"Oh, and one more thing, and we think you'll love it. You can back up your entire camera roll for just $10 a month and a really infinitesimally minuscule chance that you and your family will be completely disgraced in the public eye, and you'll get raped and murdered in prison for nothing."

Re:Apple's child protection features spark concern within it... by systoll on Thursday August 12, 2021 @08:30PM (#28163729)
Ok.

So iCloud Photos circa 2020 [and Google Photos and Facebook and Dropbox and OneDrive] aren’t a risk you should be willing to take.

This feature doesn’t change anything in that regard; the scanning was already happening.

Re:Apple's child protection features spark concern within it... by XorNot on Thursday August 12, 2021 @11:41PM (#28165137)
I literally do not take that risk in 2021. I do, currently, make the reasoned assurance that the computational overhead of pushing changes down to my phone, and the general international security community, are keeping me approximately abreast of whether my private device is actively spying on me (short answer: it definitely is, longer answer: but to what specific intent?)

Apple's new policy is: "of course your phone is scanning and flagging your private files to our server - that's normal behavior! Don't worry about it".

Re:Apple's child protection features spark concern within it... by slg on Thursday August 12, 2021 @07:42PM (#28163237)
There is also an argument that the cloud scanning is a few bit flips away from allowing random Apple employees from looking through all my photos while on device scanning means they have to be specifically looking for certain content. On device scanning is probably preferred if one's fear is someone stealing their nudes, which is one of the more common fears about photo privacy and one that Apple has already shown is a problem for them.
Re:Apple's child protection features spark concern within it... by grishka on Thursday August 12, 2021 @07:53PM (#28163356)
When you choose to use a cloud (aka someone else's computer), you trust that someone else, because you're no longer in control of what happens to your data once it leaves your device. That's a sane expectation, anyway. But you don't expect your own device to behave against your interests.
Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @07:48PM (#28163303)
Sure, but I don't particularly care because I don't upload sensitive photos to iCloud. As I'd recommend to everyone else. If it's on someone else's computer, it's not yours.

But, I suppose my iPhone was never really mine either. I knew that, I just never quite put two and two together...

Re:Apple's child protection features spark concern within it... by slg on Thursday August 12, 2021 @07:54PM (#28163377)
>Sure, but I don't particularly care because I don't upload sensitive photos to iCloud

So you are saying you have nothing to fear because you aren't hiding anything?

Is this a tacit admission that you don't want them scanning your phone for CSAM because they will find something?

I'm obviously not seriously accusing you of anything, just pointing out how your line of argument applies equally to privacy whether on the cloud or on your device.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @07:55PM (#28163390)
> So you are saying you have nothing to fear because you aren't hiding anything?

No, I'm saying that if you're hiding something, maybe don't give it to someone else.

Re:Apple's child protection features spark concern within it... by slg on Thursday August 12, 2021 @08:01PM (#28163447)
"I'm not giving my photos to anyone. I am just taking photos on my phone and Apple is automatically backing them up to iCloud. I have no idea how that feature was turned on or how to turn it off." ~ most normal people.

People here too often only think of these issues from the perspective of the type of person who browses HN. Apple is thinking of this from the perspective of an average iPhone users.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @08:04PM (#28163476)
Or, perhaps many regular users do understand the separation, and that's why this issue is getting so much attention.
Re:Apple's child protection features spark concern within it... by slg on Thursday August 12, 2021 @08:11PM (#28163538)
Is this issue getting much attention outside of tech circles? I have seen a few news stories here or there, but nothing major. I have not heard a word about it from any of my non-tech friends or from the non-tech people I follow on social media. Meanwhile people on HN are acting as if this is one of the biggest stories of the year with multiple posts on it every day.

There is a huge separation in the importance that the tech community puts on the general concept of privacy while the average person rarely worries about it.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @08:16PM (#28163586)
I mean, absent a gallop poll there's really no way to know, but we were discussing this at my office today, and I work at a graphic design studio, not a software development firm.
Re:Apple's child protection features spark concern within it... by jdavis703 on Thursday August 12, 2021 @08:18PM (#28163621)
You have to configure iCloud backups when setting up a phone for the first time. Someone who is non-technical, but privacy conscious isn’t going to do this.
Re:Apple's child protection features spark concern within it... by slg on Thursday August 12, 2021 @08:49PM (#28163873)
I don't know why technical people assume non-technical people fully understand the privacy implications of certain technology.
Re:Apple's child protection features spark concern within it... by jasamer on Monday August 16, 2021 @05:16AM (#28196281)
You could enable scanning of all files using a few bit-flips, but that doesn't have any effect - the results need to be evaluated by someone. Afaik, the system is designed such that the client side does not know whether a match occurred. So to actually report anyone based on the results of the proposed CSAM scanner, Apple also needs to upload all of the scanned files, including the client-side scan result, to figure out whether there's a match.
Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @08:27PM (#28163698)
How is it any more ‘bit flips’ away from scanning every photo on your device than it was before?
Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @08:32PM (#28163751)
Because

    if (willBeUploaded) {
        scanPhoto();
    }
can become

    if (true) {
        scanPhoto();
    }
Obviously, this is stupidly oversimplified, I have no idea how Apple has structured their code. But the fact of the matter is, if the scanning routine is already on the phone, and the photos are on the phone, all anyone has to do is change which photos get scanned by the routine...
Re:Apple's child protection features spark concern within it... by jkcxn on Thursday August 12, 2021 @09:00PM (#28163985)
By the way they already scan photos that aren’t uploaded to iCloud. I’ve never used iCloud and I can go on the photos app and search for food for example
Re:Apple's child protection features spark concern within it... by ninkendo on Thursday August 12, 2021 @09:09PM (#28164070)
Right, the difference is that now, you can be reported to the authorities for a photo that the CSAM algorithm mistook for child pornography, whereas before the image classifying was purely for your own use.
Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:14PM (#28164109)
This is simply a complete falsehood, because photos that are not uploaded are not scanned for CSAM.

Photos for your own use that you do not upload to Apple’s cloud are completely unaffected.

Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:16PM (#28164127)
Exactly. They already analysed photos on your phone for search. They don’t in fact do CSAM detection on the photos on your phone.

But why are people only objecting now when they were already doing on-device analysis?

CSAM detection is a complete red herring. It is less of a general purpose scanning mechanism than the search function that was already there.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @09:21PM (#28164164)
They're doing on device analysis, but there isn't any process by which an image of a hotdog will be sent to someone else without my knowledge.
Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:26PM (#28164206)
Right, but neither is the CSAM code being used to detect anything but CSAM.

If a bit can be flipped to make the CSAM detector go evil, surely it can be flipped to make photo search go evil, or spotlight start reporting files that match keywords for that matter.

There is nothing special about this CSAM detector except that it’s narrower and harder to repurpose than most of the rest of the system.

Re:Apple's child protection features spark concern within it... by pritambaral on Friday August 13, 2021 @08:38AM (#28168132)
> ... to make photo search go evil, or spotlight start reporting files that match keywords for that matter.

As your immediate parent has already said: there isn't any process by which an image of a hotdog will be sent to someone else without my knowledge.

Neither "photo search" nor "spotlight" report anything to third parties currently.

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @11:14AM (#28169914)
No, but a ‘bit flip’ could make them do so just as easily as a ‘bit flip’ could make the CSAM detector do something nefarious.
Re:Apple's child protection features spark concern within it... by pritambaral on Friday August 13, 2021 @06:42PM (#28175699)
How are you still not getting this?: "search" and "spotlight" do not have the code to report anything to anyone.
Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @08:49PM (#28176703)
How are you still not getting it? The code to ‘report’ something is barely more than a one liner http request. It could be added at any time.

On the other hand, making the CSAM code scan your text documents would be pointlessly difficult given that the other mechanisms exist.

Re:Apple's child protection features spark concern within it... by pritambaral on Saturday August 14, 2021 @05:24AM (#28179311)
> It could be added at any time.

It has already been added. That's the point here. The phone already has the code to report its own owner. People are rightfully pissed about that.

Also, adding a one-liner of code is a lot more than a bit-flip. That's the addition of a feature, which is a major business decision. Code that already exists is a lot closer to "misfiring" than code that simply does not. Flipping a policy config, OTOH, could be "explained" away a lot easier. In fact, Big Tech does it all the time! (Remember Facebook's "Oh. Sorry. It was a bug."?)

----

Please stop this poor attempt at moving the goalposts by saying, "But, similar code could be added at any time in the future! Why're you guys complaining now?!"

It's also not about where the scanning is happening, or whether that's new or old. The old scanning is not a problem, precisely because it does no reporting. The new scanning IS a problem, precisely because it does the reporting.

The former is not a problem on its own. The latter is. That's the point you keep missing.

Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:19PM (#28164154)
Right, but the CSAM scanning routine is absurdly narrow and difficult to use for detecting anything but CSAM, whereas a general purpose hash matching algorithm really is just a few lines of code.

This whole ‘now that they have a scanner it’s easier’ reasoning doesn’t make sense. iOS already had numerous better matching algorithms if your goal is to do general spying.

Re:Apple's child protection features spark concern within it... by zionic on Thursday August 12, 2021 @09:51PM (#28164366)
This is false information, the scanning system is highly generalized to finding any type of photo via fuzzy matched perceptual hashes.

It can target a pride flag just as easily as CP.

[dead]
Re:Apple's child protection features spark concern within it... by simion314 on Friday August 13, 2021 @12:50AM (#28165574)
>A set of multiple images must match.

How many exactly? The threshold is secret, it could be 1 or 2 or maybe it is dynamic and depends on stuff like your identity.

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @12:55AM (#28165608)
It could be 1 or 2, but the claim is that it is set to only detect people who are actually building a collection of CSAM images because Apple doesn’t want this system to flag people who are unlikely to be actual criminals. I.e. they don’t just want no false positives, they don’t want positives that aren’t highly likely to be criminal. I’m guessing it’s a lot more than 2.
Re:Apple's child protection features spark concern within it... by simion314 on Friday August 13, 2021 @01:55AM (#28165894)
> but the claim is that it is set to only detect people who are actually building a collection of CSAM

From what I read the threshold is for a different purpose, ,the false positives are too many so to reduce the number of reports the threshold workaround is introduced, so is a hack to workaround the false positives and not a threshold to catch people with big collections.

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @02:22AM (#28166044)
I have seen both in comments from Apple. Certainly spokespeople have talked about wanting any reports to NCMEC to be actionable.

I think a lot hinges on what you call a ‘false positive’. It could mean ‘an image that is not CSAM’ or it could mean ‘an account that has some apparent CSAM, but not enough to be evidence of anything’.

Re:Apple's child protection features spark concern within it... by simion314 on Friday August 13, 2021 @03:09AM (#28166315)
I think it is clear that Apple will have no choice, if they for sure find 1 CSAM image they can't say "it is just 1 img so it is not a big collection..." they have to send it to whoever to handle it.

What would help me with this kind of things would be more transparency, like to know the algorithm, the threshold, the real numbers of false positives, can the hashes be set per country or individual, can independent people look inside iOS and confirm that the code works as described...

What would also help is to know for sure hoe many children were saved by this kind of system,

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @11:17AM (#28169967)
> I think it is clear that Apple will have no choice, if they for sure find 1 CSAM image they can't say "it is just 1 img so it is not a big collection..." they have to send it to whoever to handle it.

This is a misunderstanding of how it works. The threshold has to be met before a detection occurs. Unless the threshold is met Apple doesn’t get to know about any images.

As for independent auditing and transparent statistics, I fully agree.

Re:Apple's child protection features spark concern within it... by simion314 on Saturday August 14, 2021 @02:04AM (#28178455)
You misunderstand my comment, maybe is my fault.

Let's say the threshold is 10 , you trigger the threshold so Apple checks all the 10 images , but 9 are false possitive and one appears to be a correct match, Apple will report you for 1 image ... so my point is that is not designed to catch people with big collections of CP, is designed to not trigger to often.

Re:Apple's child protection features spark concern within it... by zepto on Saturday August 14, 2021 @02:11AM (#28178475)
Ok, but the threshold is 30. It seems unlikely to be a problem.
Re:Apple's child protection features spark concern within it... by simion314 on Saturday August 14, 2021 @08:36AM (#28180155)
Yeah, I was commenting about the "collection" part of the comment.
Re:Apple's child protection features spark concern within it... by cf499 on Friday August 13, 2021 @05:27AM (#28167014)
"(...) but there are safeguards against that."

Hah! Nice one :D

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @11:20AM (#28170003)
Apple have described the safeguards. If you want to claim they are lying, by all means do so.
Re:Apple's child protection features spark concern within it... by mdoms on Friday August 13, 2021 @06:51AM (#28167454)
This is pure speculation.
Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @11:19AM (#28169985)
Not one line of it is speculation. This is taken from Apple’s public docs.
Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @09:24PM (#28164192)
Isn't the scanning routine searching for fingerprints? What happens if someone adds a fingerprint to the database, which matches something other than CSAM?
Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:39PM (#28164280)
No.

It’s way more complex than that, and has been engineered to prevent exactly that scenario.

I recommend you actually check out some of Apple’s material on this.

The idea that it’s just a list or fingerprints or hashes that can easily be repurposed is simply wrong, but is the root of almost all of the complaints.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Thursday August 12, 2021 @09:41PM (#28164297)
I've looked through Apple's paper, what are you referring to?
Re:Apple's child protection features spark concern within it... by zepto on Thursday August 12, 2021 @09:52PM (#28164377)
So you know it’s not just a fingerprint. Did you notice the parts about the safety vouchers and the visual derivatives?
Re:Apple's child protection features spark concern within it... by dannyw on Friday August 13, 2021 @04:17AM (#28166683)
Yes, I did. You do realise that CSAM is just a policy control, and there is literally nothing technical from Apple adding non-CSAM content to the same policy and systems?

I feel like you may not have actually read the paper in depth. The paper clearly shows this is a generalised solution for detecting content that perceptually matches a database. The "what" is CSAM today, but nothing about the technicals require it to be CSAM.

To answer your specific response of safety voucher and visual derivative:

- The 'safety voucher' is an encrypted packet of information containing a part of the user's decryption keys, as well as a low resolution, grayscale version of the image (visual derivative). It is better described as "backdoor voucher".

- The 'visual derivative' is just the image but smaller and grayscale.

None of those two technologies have anything to do with CSAM. Apple's statement that they will only add CSAM to the database is a policy statement. Apple can literally change it overnight to detect copyrighted content, or Snowden documents, or whatever.

Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @11:23AM (#28170041)
You are ignoring how the parts of the technology are used to separate responsibilities.

> Apple can literally change it overnight to detect copyrighted content, or Snowden documents, or whatever.

No, Apple doesn’t run the database. NCMEC does.

Re:Apple's child protection features spark concern within it... by Wowfunhappy on Friday August 13, 2021 @12:50PM (#28171375)
It doesn’t matter where the fingerprints are coming from, they’re all just fingerprints. Today they come from NCMEC. Tomorrow they could be from the Chinese Communist Party.
Re:Apple's child protection features spark concern within it... by zepto on Friday August 13, 2021 @01:08PM (#28171617)
It’s hard to take seriously the complaint that this mechanism would give the Chinese Communist party more power.

Also, in the US, the 4th Amendment protects against the abuse you are talking about:

https://www.economist.com/united-states/2021/08/12/a-38-year...

Re:Apple's child protection features spark concern within it... by jonplackett on Friday August 13, 2021 @04:28PM (#28174080)
Yes. This is it. When I wrote the above I couldn’t quite put my finger on why I felt like this but this is the reason. It’s the slippery slope of mine / yours.
Re:Apple's child protection features spark concern within it... by hamburgerwah on Thursday August 12, 2021 @06:50PM (#28162631)
Also if you remotely think the scanning is going to stop at CSAM I have a bridge in brooklyn to sell you. Copyrighted material, national security, thought crime, are already inside this trojan horse waiting to jump out.
Re:Apple's child protection features spark concern within it... by farmerstan on Thursday August 12, 2021 @08:02PM (#28163458)
In a few years, all the pedophiles will stop using iPhone, and then only innocent people will be scanned in perpetuity. Remember, if someone makes new CSAM, it won't match any hashes so even "new" pedophiles won't get caught by this.

So really, the steady state is just us regular folks getting scanned. As the years go on, what is defined as CSAM will morph into "objectionable material", and will then include "misinformation" like today. They say they won't right now, but where will things be in a few years?

Re:Apple's child protection features spark concern within it... by rootusrootus on Friday August 13, 2021 @09:23AM (#28168516)
> if someone makes new CSAM, it won't match any hashes so even "new" pedophiles won't get caught by this.

That assumes the hashes aren't recorded permanently.

Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:16PM (#28163589)
Apple just announce I would posit it will be a few weeks, not a few years. This news is everywhere.
Re:Apple's child protection features spark concern within it... by benhurmarcel on Friday August 13, 2021 @09:56AM (#28168868)
> all the pedophiles will stop using iPhone

Sounds like “mission accomplished” for Apple then

Re:Apple's child protection features spark concern within it... by nottorp on Thursday August 12, 2021 @06:44PM (#28162571)
That is how you should look at it.

They have no business scanning the phones for anything, period.

I'll refer you to the poem beginning with "First they came for the Jews...".

Re:Apple's child protection features spark concern within it... by userbinator on Thursday August 12, 2021 @07:49PM (#28163313)
"First they came for the pedophiles..."
Re:Apple's child protection features spark concern within it... by nottorp on Sunday August 15, 2021 @06:54AM (#28187754)
Yeah, and then they'll come for the gays or christians, depending on which group you feel closer to.
Re:Apple's child protection features spark concern within it... by petermcneeley on Thursday August 12, 2021 @07:03PM (#28162783)
The poem begins with "First they came for the socialists.."

https://en.wikipedia.org/wiki/First_they_came_...

Re:Apple's child protection features spark concern within it... by tpush on Thursday August 12, 2021 @08:05PM (#28163483)
'Communists' instead of 'socialists' actually; the US version is inaccurate due to anti-communist propaganda.
Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:17PM (#28163604)
Do you have a source for that?
Re:Apple's child protection features spark concern within it... by FabHK on Thursday August 12, 2021 @09:15PM (#28164118)
The original:

  Als die Nazis die Kommunisten holten, habe ich geschwiegen;
    ich war ja kein Kommunist.
  Als sie die Sozialdemokraten einsperrten, habe ich geschwiegen;
    ich war ja kein Sozialdemokrat.
  Als sie die Gewerkschafter holten, habe ich geschwiegen;
    ich war ja kein Gewerkschafter.
  Als sie die Juden holten, habe ich geschwiegen;
    ich war ja kein Jude.
  Als sie mich holten,
    gab es keinen mehr, der protestieren konnte.
https://de.wikipedia.org/wiki/Martin_Niemöller#Habe_ich_gesc...
Re:Apple's child protection features spark concern within it... by pehtis on Thursday August 12, 2021 @07:26PM (#28163052)
Yes, thats exactly how i feel. I'd still hate it if my iCloud uploads are scanned but I'm already assuming that anyway.

But the fact that my iOS device can potentially report me to any authorities, for whatever reason, is crossing a line that makes it impossible to ever own an iPhone again. I bought my first one in 2007 so I'm not saying this lightly..

Does anybody know if this policy will extend to macOS too?

Re:Apple's child protection features spark concern within it... by perardi on Thursday August 12, 2021 @07:44PM (#28163250)
I think you’re going to have to go to a flip phone, then.

Not to be, uh, flippant. Because this feels like a rather obvious slippery slope that Google will be compelled to slide down as well.

Feels like the only way to avoid such a thing would be dumb phone + Linux laptop/desktop.

Re:Apple's child protection features spark concern within it... by istingray on Thursday August 12, 2021 @08:37PM (#28163779)
Thankfully flip phones aren't necessary! Startups like Purism are at the cutting edge of building privacy-respecting devices, check it out here: https://puri.sm
Re:Apple's child protection features spark concern within it... by asddubs on Thursday August 12, 2021 @10:34PM (#28164689)
and pinephone: https://www.pine64.org/pinephone/

Plan to get one as my next phone, although it should be said that both of these offerings are still a bit rough around the edges currently, but getting there

Re:Apple's child protection features spark concern within it... by pehtis on Thursday August 12, 2021 @08:17PM (#28163611)
I wouldn't go that far. I need something with a decent browser at the very least.
Re:Apple's child protection features spark concern within it... by stephc_int13 on Thursday August 12, 2021 @07:31PM (#28163105)
It has already be announced, this is not only iOS, but all Apple devices.
Re:Apple's child protection features spark concern within it... by blisterpeanuts on Thursday August 12, 2021 @07:41PM (#28163210)
Great. I recently invested $3800 in an excellent, new iMac. Now I'm starting to wonder if I should have spent a couple thousand less for a barebones PC and installed my favorite Linux distro. It would have done 75% of what I needed, and the other 25% (music and video work)... well, that's the tradeoff.

If anyone in my circle of family, friends, and social network asks my advice, the formerly easy answer "Get a Mac, get an iPhone; you won't regret it!" is probably going to be replaced with something more nuanced ("Buy Apple, but know what you're getting into; here's a few articles on privacy....").

Re:Apple's child protection features spark concern within it... by selsta on Thursday August 12, 2021 @07:57PM (#28163406)
The CSAM detection technical summary [1] only mentions iOS and iPadOS.

If it does come to macOS it will be part of Photos.app, as that's the only way to interact with iCloud Photos. I would recommend you to avoid that app and cloud in general if you care about privacy.

[1] https://www.apple.com/child-safety/pdf/CSAM_Detection_Techni...

Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:23PM (#28163666)
That's not what I read in multiple sources. They including mac os as part of it. And why wouldn't they the software will be easy to compile into the apple photos app. https://www.zdnet.com/article/apple-child-abuse-material-sca...
Re:Apple's child protection features spark concern within it... by pehtis on Thursday August 12, 2021 @08:09PM (#28163530)
If it stays like that then it's manageable i guess.
Re:Apple's child protection features spark concern within it... by FabHK on Thursday August 12, 2021 @09:22PM (#28164173)
Looks like CSAM detection is iOS/iPadOS only (for now?). From Apple:

- Communication safety in Messages

[…] This feature is coming in an update later this year to accounts set up as families in iCloud for iOS 15, iPadOS 15, and macOS Monterey.*

- CSAM detection

[…] To help address this, new technology in iOS and iPadOS will allow Apple to detect known CSAM images stored in iCloud Photos.

- Expanding guidance in Siri and Search

[…] These updates to Siri and Search are coming later this year in an update to iOS 15, iPadOS 15, watchOS 8, and macOS Monterey.

https://www.apple.com/child-safety/

Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:20PM (#28163633)
Yes it will come with the next "+1" version due out in late fall (winter?). It will be an integral to the icloud photos platform. Supposedly if you turn off iCloud photos backup it gets turned off as well
Re:Apple's child protection features spark concern within it... by xoa on Thursday August 12, 2021 @07:56PM (#28163397)
>Does anybody know if this policy will extend to macOS too?

I don't see how it could be in the same way, or at least it only could be on brand new ARM Macs right? The thing is that at least on Intel Macs Apple simply doesn't control the whole stack. I mean, obviously, while more effort it's perfectly possible to get x86 macOS running virtualized or directly on non-Apple hardware entirely. So any shenanigans they try to pull there can get subverted or outright patched out. Without the whole hardware trust chain and heavy lock down like they have on iOS this sort of effort, even if attempted, becomes less threatening. I guess we'll see what they go for though :(. They could certainly make it pretty nasty anyway so as much as anything it's more of a forlorn hope they'll mainly focus on low hanging fruit.

Re:Apple's child protection features spark concern within it... by ksec on Thursday August 12, 2021 @07:53PM (#28163361)
I think what you describe and what is shown by Apple is "the" concrete piece of evidence, and what I have suspected for long that there is no longer any product person running the company. It used to be Steve Jobs.

You have people arguing over the technical definition of privacy, or on devices, off devices terminology. It doesn't matter. The user doesn't understand any of it. And they just feel exactly what you wrote. An intrusion of their private space by a company that has been telling you how much they value your privacy for a better part of decade.

These sort of technical explanation used to be a Tech Companies / Google / Microsoft things. Absolutely make sense to nerds, but nothing much to a layman. Now Apple are doing the same. If you watch their Keynotes, you should notice the increase usage of technical jargons or numbers for performance over the past 5 years. Something that Steve Jobs's keynote used to keep it to minimal.

Re:Apple's child protection features spark concern within it... by vineyardmike on Thursday August 12, 2021 @07:25PM (#28163037)
> I know that isn't how you should look at it, but that's still how it feels.

This is exactly how you should look at it. They turned your device against you.

Re:Apple's child protection features spark concern within it... by chrischattin on Friday August 13, 2021 @01:58AM (#28165913)
I downvoted this comment because it's hyperbole.

There are plenty of over very real concerns with this. For example, say some activist intern at Apple decides they don't like your politics and hits the report button, next thing you know, the police show up to your door and are confiscating all your devices. Just one of many potential abuses.

Re:Apple's child protection features spark concern within it... by Kim_Bruning on Thursday August 12, 2021 @08:09PM (#28163525)
I wonder how much of this is shifting the overton window. I'd really not have people scanning my data at all really.

"If you give me six lines written by the hand of the most honest of men, I will find something in them which will hang him." said Cardinal Richelieu in the 16th century.

I'm pretty sure my phone and online accounts hold a lot more data than just six lines. How do I know there won't be accidents, or 'accidents'?

Re:Apple's child protection features spark concern within it... by rowanG077 on Thursday August 12, 2021 @07:23PM (#28163014)
Why is this not how you should look at it. This is exactly how I look at it. It's your device, no company should be able to scan shit on a device that they have sold to someone. That's like keeping the key of a house after you have sold it and then checking sneakily every week whether the new owners are doing illegal stuff.
Re:Apple's child protection features spark concern within it... by pbasista on Friday August 13, 2021 @07:44AM (#28167770)
> your own, trusty iPhone

iPhone runs software which is in full control of Apple. They take active measures to stop general public from auditing its behavior (i.e. no source code, no API specifications, etc).

In my opinion, such a device can never be considered as belonging to their users or "trusted" in any reasonable way. The reason is that its root functionality always remains in control of a different entity.

I believe that such a relationship can more accurately be described as a lease.

Instead of providing specifications and source code, which would help establish the fundamental trust in their products and their behavior, Apple seems to increase their reliance on the "trust me bro" promises, which their current user base has accepted.

So far.

Re:Apple's child protection features spark concern within it... by guerrilla on Thursday August 12, 2021 @06:59PM (#28162745)
> I know that isn't how you should look at it, but that's still how it feels.

Why do you think you know that? You didn't say. It seems like that is how you should see it since they are using your processing power on your device potentially against you.

Re:Apple's child protection features spark concern within it... by jamesholden on Friday August 13, 2021 @07:30AM (#28167692)
Oh hey.. Roomba scanning for illicit drugs on your coffee table. It sounds ridiculous, but that thing is a literal camera roaming around your entire house, with machine learning.. so..
Re:Apple's child protection features spark concern within it... by skybrian on Thursday August 12, 2021 @07:33PM (#28163129)
They didn’t do themselves any favors by blurring the line between apps and the OS. If it’s just Apple’s Photos app doing this, you can install a different app and not use that one.
Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:25PM (#28163680)
That's true for now but once it gets normalized it will be extended laterally across the whole phone.
Re:Apple's child protection features spark concern within it... by noobermin on Thursday August 12, 2021 @07:28PM (#28163071)
Only thing I disagree with, it is how you should look at it and that's why it feels wrong, because it is wrong.
Re:Apple's child protection features spark concern within it... by feanaro on Friday August 13, 2021 @02:36AM (#28166126)
> I know that isn't how you should look at it, but that's still how it feels

It's definitely how you should look at it because it's right. Once a device is compromised in this way, there's no going back and the erosion of privacy and expansion of scope will become neverending. If a capability exists, it will just be too hard for spooks to keep their fingers out of the cookie jar.

Re:Apple's child protection features spark concern within it... by matt123456789 on Friday August 13, 2021 @12:57PM (#28171486)
Don’t second-guess yourself. The viewpoint you express is completely valid. Other child comments have pointed this out, but corporate messaging does not get to tell you how _you_ choose to look at things.
Re:Apple's child protection features spark concern within it... by dangerface on Friday August 13, 2021 @10:29AM (#28169300)
I think its just more visible, its easy to upload to the internet and think im uploading to the internet, you don't think I am sharing this with law enforcement and Apples third parties.
Re:Apple's child protection features spark concern within it... by thefourthchime on Thursday August 12, 2021 @08:27PM (#28163704)
I agree. While the difference is slight, one feels almost expected, the other is creepy and invasive.
Re:Apple's child protection features spark concern within it... by unityByFreedom on Friday August 13, 2021 @12:03AM (#28165299)
> I know that isn't how you should look at it

Why not? The argument seems perfectly reasonable to me.

Re:Apple's child protection features spark concern within it... by ursugardaddy on Thursday August 12, 2021 @08:21PM (#28163641)
I wouldn't be surprised if there was some weird telemetry tied to this too
Re:Apple's child protection features spark concern within it... by jpxw on Thursday August 12, 2021 @07:06PM (#28162830)
In reality, the fact that they do the scanning on-device is actually better privacy-wise. But I can see how instinctually it “feels” wrong.
Re:Apple's child protection features spark concern within it... by eCa on Thursday August 12, 2021 @07:42PM (#28163234)
Can you explain how it is better?

If they only scanned icloud I can choose to not use that.

If they scan on my iphone my choice would be to stop using that and get a gphone instead.

Re:Apple's child protection features spark concern within it... by fossuser on Thursday August 12, 2021 @08:03PM (#28163471)
It only runs if you have iCloud photos enabled.

Then it only runs client side and alerts if there are matches to CSAM hashes above some threshold.

The other way is it runs against unencrypted images in iCloud and they'd know of any match.

The new method also paves the way for the iCloud photos to be encrypted (they're currently not).

Re:Apple's child protection features spark concern within it... by AlexandrB on Thursday August 12, 2021 @08:17PM (#28163605)
> It only runs if you have iCloud photos enabled.

The detailed specifics of this would be interesting to know. If I accidentally flip iCloud photos on and then turn it off within a few minutes, would that give the system license to scan all my photos once? What if my phone is in airplane mode and I turn iCloud photos on? Will the system scan photos and create vouchers offline for later upload?

Edit: On a related note, will turning on iCloud photos now come with a modal prompt and privacy warning so you're fully informed and can't do it "by accident"? Pardon my ignorance if this happens already. I've never turned mine on and am not about to start.

Re:Apple's child protection features spark concern within it... by stjohnswarts on Thursday August 12, 2021 @08:26PM (#28163693)
Turning your own device against you is better? There is no way that is better for you as a user. It's great for governments and police forces but it doesn't do anything for you as a user but spy on you without getting a warrant.
Re:Apple's child protection features spark concern within it... by rowanG077 on Thursday August 12, 2021 @07:25PM (#28163038)
No it's not. Not scanning any content on device at all is better privacy wise.
Re:Apple's child protection features spark concern within it... by treesprite82 on Thursday August 12, 2021 @07:44PM (#28163260)
Often, despite all its disadvantages, on-device scanning would at least let know see what was being scanned for.

But Apple have circumvented that with NeuralHash. There's no way for the user to verify that only CSAM is being detected - which could be partially accomplished by having iOS only accept hashes signed by multiple independent child protection organisations (with some outside of FVEY).

Re:Apple's child protection features spark concern within it... by AceJohnny2 on Thursday August 12, 2021 @08:11PM (#28163534)
Wild thought: could on-device scanning be considered a violation of the 3rd Amendment (quartering soldiers [enforcing agents of the government] in peoples homes [property]) ?
Re:Apple's child protection features spark concern within it... by COGlory on Thursday August 12, 2021 @08:38PM (#28163782)
My understanding is that there isnt a whole lot of established anything re: the 3rd amendment. So...maybe, we can dream?

I think warantless search is a much stronger argument, though.