News for hackers. Stuff that matters.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @04:46PM (#28226879)
The thing that's shocking to me is that Google, Microsoft and all the big names in tech have been scanning everything in your account (email, cloud drive, photos, etc) for the past decade, without any noticeable uproar.

Apple announces that it is going to start scanning iCloud Photos only, and that their system is set to ignore anything below a threshold of ~30 positives before triggering a human review, and people lose their minds.

Re:Apple defends anti-child abuse imagery tech after claims ... by mightybyte on Wednesday August 18, 2021 @05:10PM (#28227210)
I think the difference here is that it's ON YOUR DEVICE. I think there's a pretty clear understanding that if you upload stuff to a cloud provider they can do whatever they want with it. This is different. This is reaching into what has up until now mostly been considered a private place. Law enforcement often has to get warrants to search this kind of thing.

This is the difference between putting CSAM on a sign in your front yard (maybe not quite front yard but I can't come up with quite the same physical equivalent to a cloud provider) and keeping it in a password protected vault in your basement. One of those things is protected in the U.S. by laws against unlawful search and seizure. Cloud and on your device are two very different things and consumers are right to be alarmed.

I'll say it again, if you are concerned with this privacy violation, sell your Apple stock and categorically refuse to purchase Apple devices. Also go to https://www.nospyphone.com/ and make your voice heard there.

Re:Apple defends anti-child abuse imagery tech after claims ... by onethought on Thursday August 19, 2021 @12:57AM (#28230473)
Only the safety tokens are generated on your device, the action triggering scan happens in the cloud (just like all the others) and then it goes to human review, so if it's a hash collision it'd be caught there when they review the images, and they can only review the images that matched CSAM.

I honestly can't find the uproar here. Google devices can face match photos offline... so they are applying a neural net (scanning) ON THE DEVICE! How is that not worse than what apple do?

Re:Apple defends anti-child abuse imagery tech after claims ... by mightybyte on Thursday August 19, 2021 @07:08AM (#28232418)
One is matching a face--yes, concerning, and I don't like it but IMO Google has had a much worse privacy reputation for quite some time--and the other is reporting private data to law enforcement and potentially abusive parents. It's quite a bit different.

The difference can also be seen from a customer service perspective. One is a feature that lets you sort according to which friends you were with. The other is a feature that puts you in jail. No thanks. Not gonna pay money for that.

Re:Apple defends anti-child abuse imagery tech after claims ... by onethought on Thursday August 19, 2021 @10:05AM (#28233974)
No it reports you to Apple, Apple report you to police. Exactly like google, they will also report you to the police, just they search your library unencrypted.

Literally no difference.

If you have illegal stuff only on your phone neither google or Apple will be notified or notify anyone else.

Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:14PM (#28227264)
ON YOUR DEVICE (where it's encrypted in a way that Apple can't read until the 30 image threshold is crossed) is more private than doing the same scan on server where a single false positive can be misused by anyone who can get a subpoena.
Re:Apple defends anti-child abuse imagery tech after claims ... by kelnos on Wednesday August 18, 2021 @11:16PM (#28229955)
A poster upthread made an analogy that I really like. Sure, like all analogies, it's imperfect, but I think it strikes at why many people are uneasy about this.

Let's say the TSA were to install air-travel-contraband scanners in everyone's homes, but promise only to scan things that are being put into your luggage as you prepare to go to the airport. And let's say that this became a requirement if you want to board a plane.

That's what this feels like. I'm fine with Google scanning through everything in my GMail account, or everything I've uploaded to GDrive, or created in GDocs. That stuff is on their servers, unencrypted, and I explicitly put it there.

But I'm sure as hell not going to let Google install something on my laptop (or phone!) that lets them look at my stuff, even if they pinky-promise that they'll only scan stuff that I intend to upload.

Re:Apple defends anti-child abuse imagery tech after claims ... by mightybyte on Wednesday August 18, 2021 @06:40PM (#28228047)
> ON YOUR DEVICE (where it's encrypted in a way that Apple can't read until the 30 image threshold is crossed)

First of all, you have to be able to read it to do the comparison that can increment the counter to 30. So regardless of whether it is or is not encrypted there, they're accessing the unencrypted plaintext to calculate the hash.

And yes, on my device is definitively more private than on someone else's server--just like in my bedside drawer is more private than in an office I rent in a co-working space.

Re:Apple defends anti-child abuse imagery tech after claims ... by heavyset_go on Wednesday August 18, 2021 @06:20PM (#28227874)
> where it's encrypted in a way that Apple can't read

This doesn't matter because Apple can read iCloud data, including iCloud Photos. They hold the encryption keys, and they hand over customers' data for about 150,000 users/accounts a year in response to requests from the government[1].

[1] https://www.apple.com/legal/transparency/us.html

Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @10:03PM (#28229524)
Of course Apple can read iCloud data.

How do you think Google and Microsoft scan everything in your account? They all have the capability to read your cloud data.

What Apple cannot read are the results of your device scanning your iCloud Photos. Those results are encrypted and stay that way until your device finds 30 matches for known kiddie porn.

Once you pass the threshhold, Apple gets the decryption key and a human review is triggered to make sure there weren't just 30 false positives.

Re:Apple defends anti-child abuse imagery tech after claims ... by pasquinelli on Wednesday August 18, 2021 @05:18PM (#28227312)
what kind of encryption can't be decrypted until some threshold has been crossed?

maybe you mean to say that apple says they won't read it until that threshold has been crossed.

Re:Apple defends anti-child abuse imagery tech after claims ... by zepto on Wednesday August 18, 2021 @05:46PM (#28227588)
> what kind of encryption can't be decrypted until some threshold has been crossed?

The kind Apple has built. You should read the docs. This is literally how it works.

Re:Apple defends anti-child abuse imagery tech after claims ... by mightybyte on Wednesday August 18, 2021 @06:37PM (#28228025)
This is the same company that saved the disk encryption password as the password hint. You really trust them to not screw this up when the stakes are that it could ruin your life and/or land you in jail? I'm simply not ok with that.
Re:Apple defends anti-child abuse imagery tech after claims ... by zepto on Wednesday August 18, 2021 @08:04PM (#28228789)
How exactly do you imagine a bug in this will land you in jail?
Re:Apple defends anti-child abuse imagery tech after claims ... by mightybyte on Thursday August 19, 2021 @07:12AM (#28232450)
Ever heard of planted evidence?
Re:Apple defends anti-child abuse imagery tech after claims ... by zepto on Thursday August 19, 2021 @04:33PM (#28239007)
You haven’t explained how evidence could be planted. That is what you are being asked.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:25PM (#28227388)
No, I'm saying they designed the system so that they don't have the key to decypt the scan result "vouchers" until after the device tells them that the 30 image threshold is crossed.

>Apple is unable to process individual vouchers; instead, all the properties of our system mean that it’s only once an account has accumulated a collection of vouchers associated with illegal, known CSAM images that we are able to learn anything about the user’s account.

Now, why to do it is because, as you said, this is something that will provide that detection capability while preserving user privacy.

https://techcrunch.com/2021/08/10/interview-apples-head-of-p...

Meanwhile, a single false positive from an on server scan is open to malicious use by anyone who can get a subpeona.

Re:Apple defends anti-child abuse imagery tech after claims ... by telside on Wednesday August 18, 2021 @05:49PM (#28227615)
The lady doth protest too much, methinks

Just going to respond to every post on here with these absurd points? K apple guy.

Re:Apple defends anti-child abuse imagery tech after claims ... by brandon272 on Wednesday August 18, 2021 @05:08PM (#28227179)
Here's the reason for the sudden uproar: The scanning of things on third party servers was just barely tolerated by a lot of people, whether it's for advertising purposes or government intrusion. People accept it because it's considered reasonable for these third parties to scan data in exchange for providing a service for free (e.g. Google), or because they need to have some degree of accountability for what is on their servers.

When that scanning gets moved from the cloud to being on your device, a boundary is violated.

When that boundary is violated by a company who makes extreme privacy claims like saying that privacy is a "fundamental human right"[1], yes, people will "lose their minds" over it. This shouldn't be shocking at all.

[1] https://apple.com/privacy

Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:34PM (#28227473)
When the scanning gets moved from the cloud to being on device, Apple itself cannot see the results of the scan until the risk that the result is only a false positive is greatly reduced.

You would have to have 30 false positives before Apple can see anything, which is unlikely, but the next step is still a human review, since it's not impossible.

Re:Apple defends anti-child abuse imagery tech after claims ... by OnlineGladiator on Wednesday August 18, 2021 @05:56PM (#28227672)
I don't care. It's my device (at least that's how Apple used to advertise it) and I disagree with Apple's policy, full stop. I don't care about "think of the children" (especially since they will be scanning pictures of my own children), and furthermore I don't trust Apple not to change the policy in the future. They've created a backdoor and now the device is compromised and privacy is broken. If you want to trust Apple go ahead. They have eroded my trust and I doubt they could regain it within a decade.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @06:24PM (#28227918)
>I don't care

If anything, you should be outraged that Google and Microsoft have been scanning much more of your data, and doing so in a much more intrusive way.

Apple only scans iCloud Photos and they do so in a way that they can't see the results until they can be reasonably sure it's not just a false positive.

Re:Apple defends anti-child abuse imagery tech after claims ... by OnlineGladiator on Wednesday August 18, 2021 @07:13PM (#28228355)
You have clearly misunderstood my position as you have replied to 2 of my comments already. You seem to have an "Apple vs the world" mentality when my point is entirely about holding Apple accountable to their own marketing. You sound like a bizarre Apple apologist and I'm tired of trying to explain myself to you when all you want to do is explain to me why Apple is better than everybody when I do not care and also fundamentally disagree.

If you think Apple's approach is the best you're allowed to think that. I disagree.

Re:Apple defends anti-child abuse imagery tech after claims ... by brandon272 on Wednesday August 18, 2021 @06:02PM (#28227716)
Whether or not Apple can see the results is completely irrelevant, to me at least. Automated surveillance is still surveillance.
Re:Apple defends anti-child abuse imagery tech after claims ... by OnlineGladiator on Wednesday August 18, 2021 @04:54PM (#28227010)
The other companies didn't advertise and pride themselves on being privacy focused. Part of the appeal of Apple was that you could avoid that issue and they touted it regularly. Now they're telling their customers to go fuck themselves (so long as they're 18 or older).
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:02PM (#28227110)
Conducting the scan on the user's device instead of on the companies server is more private.

Apple can't decrypt the results of the scan until the ~30 image threshold is crossed and a human review is triggered.

Given Google's reluctance to hire humans when a poorly performing algorithm is cheaper, are they turning over every single false positive without a human review?

Re:Apple defends anti-child abuse imagery tech after claims ... by lifty on Wednesday August 18, 2021 @06:06PM (#28227751)
I guess people had a sense of ownership of these devices and they feel that it’s doing some they they don’t want. If ownership means control, maybe in the digital age full ownership/control is not really possible on a managed device like the iPhone. There are other example like the John Deer tractor issues.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @06:26PM (#28227931)
I have a sense of ownership over my non-publicly-accessible data when it's backed up to a cloud drive.

Apple isn't scanning that.

Google and Microsoft are.

Re:Apple defends anti-child abuse imagery tech after claims ... by lifty on Wednesday August 18, 2021 @06:36PM (#28228017)
Sure, you own the data, but you don’t have any control on what’s happening to it. Just like iPhone users, we own the physical device but we only control certain aspects of what it’s doing, and the boundaries are not set by us, but by Apple.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @07:07PM (#28228296)
If I back up my files to Apple's cloud server, I don't have to worry about them scanning my private files at all.

They don't cross that line like Google and Microsoft do.

With Apple, nothing but files you upload to iCloud Photos get scanned.

Re:Apple defends anti-child abuse imagery tech after claims ... by GuB-42 on Wednesday August 18, 2021 @06:19PM (#28227865)
Google is open about the fact they scan and track everything, they even make it a point of convenience "hey, we looked at your email and found a plane ticket, based on where you are, you should leave in 2 hours if you want to be at the airport on time".

Facebook, even more so, they are explicitly anti-privacy to the point of being insulting.

Microsoft will happily show you everything they may send when you install Windows, you can sometimes refuse, but not always. They are a bit less explicit than Google, but privacy is rarely on the menu.

As for Amazon, their cloud offers are mostly for businesses, different market, but still, for consumers, they don't really insist on privacy either.

So that if any of these company scan your pictures for child porn, it won't shock anyone, because we know it is what they do.

But Apple claims privacy as a core value, half of their ads are along the lines of "we are not like the others, we respect your privacy, everything on your device stays on your device, etc...", they announce every (often legitimate) privacy feature with great fanfare, etc... So much that people start to believe it. But with that, people realize that Apple is not so different from the others after all, and if they bought an overpriced device based on that promise, I understand why they are pissed off.

Re:Apple defends anti-child abuse imagery tech after claims ... by heavyset_go on Wednesday August 18, 2021 @04:55PM (#28227020)
This seems like a common deflection, but get back to me when either company puts programs in my pocket that scan my data for crimes and snitch on me to authorities.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:05PM (#28227143)
>a man [was] arrested on child pornography charges, after Google tipped off authorities about illegal images found in the Houston suspect's Gmail account

https://techcrunch.com/2014/08/06/why-the-gmail-scan-that-le...

You don't consider the contents of your email account or the files you mirror to a cloud drive to be your own private data?

Re:Apple defends anti-child abuse imagery tech after claims ... by WA on Wednesday August 18, 2021 @05:21PM (#28227340)
No OP, but yes. I expect that my emails can be read and that my files on a cloud service can be accessed. And I don’t even use Gmail.

I expect that my ISP tracks and stores my DNS resolutions (if I use their DNS) and has a good understanding of the websites I visit.

I expect that an app that I grant access to my contacts uploads as much data as it can to their servers.

I expect WhatsApp and similar apps to collect and upload meta data of my entire photo library such as GPS info the second I give them access.

Hence, I don’t give access. And hence, it’s a problem if there is no opt-out of local file scanning in the future.

Re:Apple defends anti-child abuse imagery tech after claims ... by _trampeltier on Wednesday August 18, 2021 @05:17PM (#28227297)
There are worlds between. One case is about pictures on your device. The other case is about pictures on Googles "devices" or network. You had to upload it to Google. EMail is also nothing like a letter anyway. It's a postcard. Everybody can read it.
Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:30PM (#28227435)
No, one case is about photos you upload to iCloud Photos only, and the other case is about every single thing in your Google account.

>So if iCloud Photos is disabled, the system does not work, which is the public language in the FAQ. I just wanted to ask specifically, when you disable iCloud Photos, does this system continue to create hashes of your photos on device, or is it completely inactive at that point?

If users are not using iCloud Photos, NeuralHash will not run

https://techcrunch.com/2021/08/10/interview-apples-head-of-p...

Re:Apple defends anti-child abuse imagery tech after claims ... by heavyset_go on Wednesday August 18, 2021 @06:12PM (#28227808)
No, that happens on Google's servers and is not an agent in my pocket that scans and invades my personal property for evidence of crimes and snitches on me to authorities.
Re:Apple defends anti-child abuse imagery tech after claims ... by bobthepanda on Wednesday August 18, 2021 @04:59PM (#28227082)
At least Google does.

https://protectingchildren.google/intl/en/

> CSAI Match is our proprietary technology, developed by the YouTube team, for combating child sexual abuse imagery (CSAI) in video content online. It was the first technology to use hash-matching to identify known violative videos and allows us to identify this type of violative content amid a high volume of non-violative video content. When a match of violative content is found, it is then flagged to partners to responsibly report in accordance to local laws and regulations. Through YouTube, we make CSAI Match available for free to NGOs and industry partners like Adobe, Reddit, and Tumblr, who use it to counter the spread of online child exploitation videos on their platforms as well.

> We devote significant resources—technology, people, and time—to detecting, deterring, removing, and reporting child sexual exploitation content and behavior. Since 2008, we’ve used “hashing” technology, which creates a unique digital ID for each known child sexual abuse image, to identify copies of images on our services that may exist elsewhere.

Re:Apple defends anti-child abuse imagery tech after claims ... by arsome on Wednesday August 18, 2021 @05:02PM (#28227111)
Note that they're not pushing it to devices that consumers have purchased, just running it on their cloud services. I think it's an important distinction here with what Apple is doing.
Re:Apple defends anti-child abuse imagery tech after claims ... by heavyset_go on Wednesday August 18, 2021 @05:03PM (#28227112)
No, that happens on Google's servers and isn't an agent in my pocket that runs on and invades my personal property. It's also only for videos.
Re:Apple defends anti-child abuse imagery tech after claims ... by bobthepanda on Wednesday August 18, 2021 @05:06PM (#28227160)
The images being scanned are the ones that go to iCloud.

The Google page has a section later down that also says they use hashing of images.

Re:Apple defends anti-child abuse imagery tech after claims ... by GeekyBear on Wednesday August 18, 2021 @05:10PM (#28227221)
When the scan is carried out on device, Apple can't read the results of the scan until the 30 image threshold is reached.

When Google scans on server, a single false positive result can be abused by anyone who can get a warrant.

>Innocent man, 23, sues Arizona police for $1.5million after being arrested for murder and jailed for six days when Google's GPS tracker wrongly placed him at the scene of the 2018 crime

https://www.dailymail.co.uk/news/article-7897319/Police-arre...

Apple's method is more private.

Re:Apple defends anti-child abuse imagery tech after claims ... by websites2023 on Wednesday August 18, 2021 @04:51PM (#28226961)
BigCos, take note: you’re better off doing nefarious shit without telling anyone. Because, if you come clean, you’ll only invite an endless parade of bloggers who will misconstrue your technology to make you look bad.
Re:Apple defends anti-child abuse imagery tech after claims ... by __blockcipher__ on Wednesday August 18, 2021 @05:08PM (#28227181)
No misconstrual needed. This technology is genuinely bad. It scans images against an arbitrary government-owned black-box database. There’s no guarantee that it’s only CSAM.
Re:Apple defends anti-child abuse imagery tech after claims ... by OrvalWintermute on Wednesday August 18, 2021 @05:24PM (#28227376)
I have a serious problem imagining that Apple will not be willing to redeploy this technology in a novel and nefarious means in exchange for continued market access when billions are on the line.

Mainland China will probably be the first chip to fall. Can't imagine the Ministry of State Security not actively licking their lips, waiting for this functionality to arrive.

Re:Apple defends anti-child abuse imagery tech after claims ... by websites2023 on Wednesday August 18, 2021 @05:09PM (#28227202)
NECMEC isn’t owned by the government and the database of hashes is available from Apple.
Re:Apple defends anti-child abuse imagery tech after claims ... by commoner on Wednesday August 18, 2021 @05:30PM (#28227433)
> NECMEC isn’t owned by the government

Even though NCMEC describes itself as "private", it was established by and has been heavily funded by the U.S. government.

From an archive of NCMEC's own history page, cited on Wikipedia (https://web.archive.org/web/20121029010231/http://www.missin...):

> In 1984, the U.S. Congress passed the Missing Children’s Assistance Act which established a National Resource Center and Clearinghouse on Missing and Exploited Children. The National Center for Missing & Exploited Children was designated to fulfill this role.

> On June 13, 1984, the National Center for Missing & Exploited Children was opened by President Ronald Reagan in a White House Ceremony. The national 24-hour toll-free missing children’s hotline 1-800-THE-LOST opened as well.

$40 million/year of U.S. government funding from a 2013 bill (https://en.wikipedia.org/wiki/Missing_Children%27s_Assistanc...):

> The Missing Children's Assistance Reauthorization Act of 2013 (H.R. 3092) is a bill that was introduced into the United States House of Representatives during the 113th United States Congress. The Missing Children's Assistance Reauthorization Act of 2013 reauthorizes the Missing Children's Assistance Act and authorizes $40 million a year to fund the National Center for Missing and Exploited Children.

Re:Apple defends anti-child abuse imagery tech after claims ... by tjfl on Wednesday August 18, 2021 @05:28PM (#28227419)
They're not owned by the federal government, but they do get a lot of federal government money.

> The National Center for Missing & Exploited Children® was established in 1984 as a private, nonprofit 501(c)(3) organization. Today, NCMEC performs the following 15 specific programs of work, funded in part by federal grants (34 U.S.C. § 11293): Source: https://www.missingkids.org/footer/about

US DOJ OJJDP lists recent grants totaling $84,446,366 in FY19 and FY20. Source: https://ojjdp.ojp.gov/funding/awards/list?awardee=NATIONAL%2...

Re:Apple defends anti-child abuse imagery tech after claims ... by __blockcipher__ on Wednesday August 18, 2021 @05:42PM (#28227556)
And don’t forget, it’s way more than just money:

https://www.law.cornell.edu/uscode/text/18/2258A

You must report to them and only them.

For the GP to claim they’re not government “owned” is a rhetorical trick at best and outright ignorant absurdity at worst.

Re:Apple defends anti-child abuse imagery tech after claims ... by __blockcipher__ on Wednesday August 18, 2021 @05:40PM (#28227530)
That’s like saying the federal reserve is “private”. No, the NECMEC is not a private entity. Not only was it heavily funded/created by the gov, but more importantly it is granted special legal status. You and I can’t just spin up our own CSAM database. Nor do we have any laws that say that any companies aware of CSAM must send it to us and only us.
Re:Apple defends anti-child abuse imagery tech after claims ... by justin_oaks on Wednesday August 18, 2021 @04:56PM (#28227034)
It's important to keep nefarious stuff on the server side because eventually someone will reverse engineer what's on the client side.

Imagine if Apple had done this on the client side without telling anyone, and later it was discovered. I think things would be a whole worse for Apple in that case.

Re:Apple defends anti-child abuse imagery tech after claims ... by squarefoot on Wednesday August 18, 2021 @10:42PM (#28229764)
Devices with proprietary OSes spend more and more time phoning home, then exchanging data officially for "updates". They probably tell the truth, but should one of them decide to hide users data exfiltration or other monitoring practices behind those updates, it would be quite hard to catch them. In other words we have no way to tell that they're not already doing this.
Re:Apple defends anti-child abuse imagery tech after claims ... by websites2023 on Wednesday August 18, 2021 @06:57PM (#28228186)
That being the case, why do it client side at all, when presumably every claim they make is verifiable?
Re:Apple defends anti-child abuse imagery tech after claims ... by Copernicron on Wednesday August 18, 2021 @05:17PM (#28227298)
Most people don't pay attention to whether or not their stuff is being scanned. Those of us who do pay attention have known for a long time that it's being scanned. Especially by Google and Facebook. Basically anyone whose business model is based off of advertising. My default assumption is anything I upload is scanned.
Re:Apple defends anti-child abuse imagery tech after claims ... by rblatz on Wednesday August 18, 2021 @05:47PM (#28227597)
Because it isn’t about the CSAM scanning. Apple keeps reframing the argument back to that. most people expect that google and Microsoft to scan files on their servers for CSAM, people object to Apple turning your phone against its owner, and once building out the capability to do this only policy prevents it from being abused.
Re:Apple defends anti-child abuse imagery tech after claims ... by xdennis on Wednesday August 18, 2021 @09:39PM (#28229380)
> all the big names in tech have been scanning everything in your account [...] without any noticeable uproar

In part because people didn't know.

And if you were one of innocent people caught by them, you wouldn't want people to know.