News for hackers. Stuff that matters.
Re:Apple Delays Rollout of Child Safety Features by Bud on Friday September 03, 2021 @09:35AM (#28404009)
Apple doesn't "sneak in" stuff like this. That's complete bullshit. Could we at least discuss in good faith?
Re:Apple Delays Rollout of Child Safety Features by npteljes on Friday September 03, 2021 @09:55AM (#28404281)
I think OP referred to the finding that Apple already rolled out parts of the detection thing

https://www.reddit.com/r/MachineLearning/comments/p6hsoh/p_a...

Re:Apple Delays Rollout of Child Safety Features by spywaregorilla on Friday September 03, 2021 @10:08AM (#28404432)
Isn't this the bad part? Like... it being there is the problem, not apple specifically using it for child porn detection. Right?
Re:Apple Delays Rollout of Child Safety Features by macksd on Friday September 03, 2021 @10:22AM (#28404590)
Correct. If we could magically end the rape of children and stop the propagation of images of such, I think we'd all be on board. But when a system would realistically just push most of it elsewhere and violate a bunch of innocent people's privacy, people get nervous.

It's like being asked to have an invasive, detailed scan of your body shown to TSA personnel (and recorded) when you fly. The motive is apparently to prevent violence. But there were still incidents on flights when that was being done. It wouldn't have caught the box cutters on 9/11. The stated motive ceases to be part of the equation for me.

Re:Apple Delays Rollout of Child Safety Features by azinman2 on Friday September 03, 2021 @11:14AM (#28405302)
Pushing it elsewhere is still a win. You don’t want this to have easy cover. Keep in mind FB reported close to 17M pieces of CSAM last year. So if having the ability to detect it was such a deterrent, why are their numbers so high?
Re:Apple Delays Rollout of Child Safety Features by sbuk on Friday September 03, 2021 @11:24AM (#28405450)
Because the don't tell anyone what they are scanning?
Re:Apple Delays Rollout of Child Safety Features by azinman2 on Friday September 03, 2021 @11:49AM (#28405750)
They literally publicize these numbers. It’s not like I somehow know this FB secret. Every cloud provider scans, except Apple.
Re:Apple Delays Rollout of Child Safety Features by sbuk on Friday September 03, 2021 @03:02PM (#28408015)
Apple currently do scan for CSAM in their cloud.
Re:Apple Delays Rollout of Child Safety Features by azinman2 on Friday September 03, 2021 @06:30PM (#28410138)
Their reported numbers were like 350 last year, compared to almost 17M for Facebook. You could theorize Apple has little CP, except in the Epic lawsuit we saw exec emails released that said the exact opposite. So clearly not much scanning has been going on.
Re:Apple Delays Rollout of Child Safety Features by dwaite on Friday September 03, 2021 @03:34PM (#28408410)
For email only
Re:Apple Delays Rollout of Child Safety Features by mlindner on Friday September 03, 2021 @11:15AM (#28405304)
I think it's actually impossible to use an AI to determine this type of thing. Even courts of humans sometimes rarely get it wrong sometimes with images that are open for debate (for example missing context) on whether it was abusive or not (parents bathing their kids, as one example). Then you have the whole can of worms that pedophiles will find sexual interest in images taken in non-abusive contexts but will use them none the less. How is an AI supposed to determine that. Even our laws can't handle that.

There's also images that can be abusive if made public but non-abusive if kept private. For example what about a kid taking pictures of themselves nude (many kids don't have parental moderated accounts) and putting them on icloud (iphone does this automatically with default settings).

It's a complete nuthouse and there's no way to do it.

(Also don't get me started on drawn artwork (or 3D CG) that people can create that can show all sorts of things and is fully or partially legal in many countries.)

Re:Apple Delays Rollout of Child Safety Features by scoopertrooper on Friday September 03, 2021 @12:04PM (#28405974)
They're not using an AI for that purpose. They're just sending a hash of the image and sending it along with iCloud uploads. The hashes are of images that have been identified by humans as containing child pornography.
Re:Apple Delays Rollout of Child Safety Features by eurasiantiger on Friday September 03, 2021 @01:57PM (#28407280)
No, the hashes are visual hashes. It is completely possible that a clean shaven adult taking pictures of themselves could get flagged.
Re:Apple Delays Rollout of Child Safety Features by mrtranscendence on Friday September 03, 2021 @03:18PM (#28408204)
It's also possible that a picture of an avocado will get flagged. A nude photo of someone who's shaved themselves is unlikely to look so much like an actual CSAM photo that it'll get flagged. It's certainly possible, but again, so's the avocado.
Re:Apple Delays Rollout of Child Safety Features by godelski on Friday September 03, 2021 @02:17PM (#28407502)
They're not hashes in the way md5sum or sha256 is a hash. They are _neural_ hashes. Which is not trying to fingerprint a specific image, but tag any image that is deemed sufficiently similar to the reference image. Hashes are unique, neural hashes aren't.

To add, there are natural neural hash collisions in ImageNet (a famous ML dataset). Images that look nothing alike to us humans.

Re:Apple Delays Rollout of Child Safety Features by Grustaf on Friday September 03, 2021 @02:31PM (#28407676)
Since the threshold is 30 images, and those images are matched to a curated database of abusive material, what you write here simply doesn't apply.
Re:Apple Delays Rollout of Child Safety Features by vmladenov on Saturday September 04, 2021 @03:16PM (#28418162)
Apple already does virus scanning on device and has for a decade. I fail to see how you trust one proprietary binary file scanner to stay in its lane and not spy on you, but fear a different one with a different stated purpose.
Re:Apple Delays Rollout of Child Safety Features by mlindner on Friday September 03, 2021 @11:05AM (#28405161)
Yeah but no one's found any evidence that any code calls it. (At least not that I've seen.)
Re:Apple Delays Rollout of Child Safety Features by arminiusreturns on Friday September 03, 2021 @11:17AM (#28405351)
Black box closed source systems sorta make verification of what the device is doing rather difficult.
Re:Apple Delays Rollout of Child Safety Features by djrogers on Friday September 03, 2021 @12:00PM (#28405913)
Not really - there are a ton of ways to profile and monitor a Mac to determine what processes are calling into what, and spotting something activating this code oth would be trivial if it were happening.
Re:Apple Delays Rollout of Child Safety Features by arminiusreturns on Friday September 03, 2021 @12:55PM (#28406616)
You say that, but there are also tons of ways to hide such things (there is an entire field dedicated to side-channel leakage). The point is you don't know unless you have the source code (and can compile it yourself, I'm ignoring the trust of compilers at the moment). You can try to reverse engineer and analyse all you want, but it doesn't mean you know what the system is really doing...
Re:Apple Delays Rollout of Child Safety Features by cwkoss on Friday September 03, 2021 @02:44PM (#28407819)
It may be trivial to look under a given rock, but when there are hundreds of thousands of rocks, the likelihood of someone noticing something left under a rock is low.
Re:Apple Delays Rollout of Child Safety Features by Piskvorrr on Friday September 03, 2021 @11:28AM (#28405487)
"Yeah, we have this really suspicious code here, sure, but we have not started calling it. Pinky swear."

The issue here is not the trustworthiness of the pinky swear...

Re:Apple Delays Rollout of Child Safety Features by mlindner on Friday September 03, 2021 @11:43AM (#28405662)
I'm not saying it's a good situation, but it's not terrible yet.
Re:Apple Delays Rollout of Child Safety Features by Piskvorrr on Friday September 03, 2021 @11:49AM (#28405748)
I am reminded of the joke "an optimist falls from a skyscraper. At second floor, he thinks: 'so far, so good.'"

In other words, a situation that seems to be a feature toggle away from becoming terrible is terrible in itself.

Re:Apple Delays Rollout of Child Safety Features by post_break on Friday September 03, 2021 @09:39AM (#28404055)
Well I don't mean by doing it without telling everyone. I mean wait until it dies down, then just be like oh btw 15.X includes CSAM scanning as a change log bulletin.
Re:Apple Delays Rollout of Child Safety Features by haswell on Friday September 03, 2021 @09:56AM (#28404287)
Given the uproar on this change, and the fact that the uproar was big enough to cause this delay, can you imagine the bad press if they come back later and roll this out quietly?

Editing to add: I think this will play out more like the butterfly keyboard debacle. They won’t ever really acknowledge how bad the original thing was, but they’ll return to a solution the community finds palatable (server side scanning), and wrap it up in a bow like they did with the “magic keyboard, now on our laptops”.

Re:Apple Delays Rollout of Child Safety Features by vxNsr on Friday September 03, 2021 @10:43AM (#28404864)
They just need to time it right.
Re:Apple Delays Rollout of Child Safety Features by stjohnswarts on Friday September 03, 2021 @10:54AM (#28405034)
They were trying to make a small press release about it and be done hoping no one would notice. Instead everyone got mad and called them out on it. That is where they attempted to sneak it in. Not everything is black and white and the terminology is sufficient to describe the situation.
Re:Apple Delays Rollout of Child Safety Features by djrogers on Friday September 03, 2021 @12:05PM (#28405994)
Wait a sec - this wasn’t a ‘small press release’, it was a huge one, made several months in advance of the feature launching, accompanied by a bunch of interviews with execs.

If you look at the tone of all of it, they also honestly felt this was the most privacy preserving way to do CSAM scanning - likely so they can enable E2EE on everything iCloud.

What they got very very wrong was the public reaction to it.

Re:Apple Delays Rollout of Child Safety Features by TimTheTinker on Friday September 03, 2021 @01:39PM (#28407108)
> What they got very very wrong was the public reaction to it.

What they got very wrong is that this fundamentally changes the nature of iPhones -- they are no longer user agents; in fact, they're actively scanning user data on behalf of another party. That change doesn't just make people feel uncomfortable, it opens the door for untold myriads of abuses.

It's one thing if iCloud servers scan user data - those servers never were assumed to be user agents. It's entirely different when user-owned devices do this.

Re:Apple Delays Rollout of Child Safety Features by Zak on Friday September 03, 2021 @12:31PM (#28406333)
What they got very very wrong is the idea that spyware running on the user's device is the most privacy preserving way to scan for illegal content hosted on their servers.

Apple has not announced E2EE for files stored on iCloud. If that is their intent, they likely would have had a somewhat improved public response by announcing it at the same time as the on-device spyware.

Re:Apple Delays Rollout of Child Safety Features by sneak on Friday September 03, 2021 @12:11PM (#28406078)
> likely so they can enable E2EE on everything iCloud.

Refers to facts not in evidence.

Additionally, they have previously voluntarily declined to enable e2e on systems to aid government surveillance.

This is baseless speculation, and, given what we know about Apple's history with e2e, not only baseless but actually unlikely.

Re:Apple Delays Rollout of Child Safety Features by azinman2 on Friday September 03, 2021 @11:15AM (#28405315)
A press release is the exact opposite of sneaking something in.
Re:Apple Delays Rollout of Child Safety Features by behnamoh on Friday September 03, 2021 @12:32PM (#28406343)
> Could we at least discuss in good faith?

I'm afraid good faith is not gonna protect your privacy.

Re:Apple Delays Rollout of Child Safety Features by yummypaint on Friday September 03, 2021 @09:59AM (#28404318)
Their practice of suripticiously pushing updates to older phones to kill the battery life would seem to fit that bill. Their updates aren't open either, people just take them at their word. If the law or EULA doesn't ouright prohibit them from doing something it's prudent to assume they already are.
Re:Apple Delays Rollout of Child Safety Features by api on Friday September 03, 2021 @09:39AM (#28404062)
Google or (worse) Facebook would have just put this in with no press release.

My read is that Apple is trying to placate governments by throwing them a bone without totally abandoning their privacy stance, hence the drive to put the scanning on the actual device so all your photos don't have to be shared as-is with Apple. That way they can encrypt iCloud but still keep the feds from accusing them (in bad faith) of being a child porn trading platform.

The alternative is to keep iCloud unencrypted and scan in the cloud, which is what they and everyone else already does.

One of the pieces of feedback they got though is that people are more okay with that than with scanning on the device. People expect that things that go to the cloud are no longer private unless you run some kind of local encryption that you control.

The reason they don't care about photos not sent to iCloud is the trading platform angle. It's one thing to let people store shit on their own devices. It's another thing to be a large scale and easy to use secure channel that people can use to share CP. The nightmare scenario for Apple would be to become a de-facto standard in the CP underworld for sharing content.

Sure people can use Tor, private VPNs and mesh networks, PGP, or many other things, but that requires a level of technical knowledge that greatly reduces the size of the audience.

Maybe a better alternative for Apple would be to add iCloud encryption but to stipulate that any sharing of content disables encryption for the shared content. That way they could scan shared content only. For unshared content iCloud is basically just an encrypted backup.

Re:Apple Delays Rollout of Child Safety Features by simion314 on Friday September 03, 2021 @10:28AM (#28404656)
>My read is that Apple is trying to placate governments by throwing them a bone

You would believe this if you only read/watch Apple PR and ignore reality. The actual reality is that Apple always collaborates with all governments. The reality is that Apple did not announce any new end to end encryption that would use this feature and did not promise such a feature.

Re:Apple Delays Rollout of Child Safety Features by api on Friday September 03, 2021 @10:50AM (#28404965)
Apple isn't altruistic, but I do think they want to have strong privacy. They cooperate with governments to what seems to be the minimum extent required to do business in a given country. They can't change governments.

In China and other more authoritarian nations that means cooperating a lot. If you don't you do no business in China. In the USA they seem to be looking for a new minimum level of cooperation, or trying to enhance privacy a little without moving the needle.

In any case this particular strategy looks like a failure in the market. They might re-engineer it or backpedal or just toss the whole idea of encrypting iCloud.

Re:Apple Delays Rollout of Child Safety Features by simion314 on Friday September 03, 2021 @11:11AM (#28405245)
>Apple isn't altruistic, but I do think they want to have strong privacy.

Maybe if you define privacy that Google and FB do not track you and only Apple do. You open an application on your Mac and the event was sent insecure to Apple , find a definition of privacy that is not contradictory with what Apple was doing.

Re:Apple Delays Rollout of Child Safety Features by nick__m on Friday September 03, 2021 @12:29PM (#28406308)
If it was the trading platform angle, could they just scan on share or am I missing something ?
Re:Apple Delays Rollout of Child Safety Features by eldaisfish on Friday September 03, 2021 @10:49AM (#28404942)
what apple are trying to do is minimise damage to their bottom line from bad PR. At the end of the day, more people must realise that corporations are beholden to one thing - money.

Morality barely matters and legality is something easily skirted around with the right legal argument. Apple, google etc with continue working with governments so long as their profit can flow from those countries.