News for hackers. Stuff that matters.
Re:Hash collision in Apple NeuralHash model by ksec on Wednesday August 18, 2021 @10:55AM (#28221869)
I actually want Apple to stand ground and implement this feature. Like you said the double down on PR and marketing was enough for me. I may not be dumping all iOS and Mac for now. But it was "the" definite signal and evidence this is no longer the old Steve Jobs's Apple. It is like watching Mark Zuckerberg talking about privacy when he doesn't understand anything about it. ( Or more like he has a different understand of privacy than most people )

If they stand ground it makes the decision a lot easier for others. If they dont they will continue to use the boiling frog tactics.

After all they dont think they are wrong and they are still righteous. And It would be far more interesting to see how the world folds. The whole computing market, Google, Apple and Microsoft are currently operating with a moat that is literally impenetrable. This will be a small push towards a new world of possibilities.

Yes. I really hope they stand ground. I wish I won the lottery I could put a few million into the Social Media echo chamber to support this. Or you know, cough certain Apple competitor could do this.

Re:Hash collision in Apple NeuralHash model by danuker on Wednesday August 18, 2021 @11:11AM (#28222171)
Chances are by the next sales report it will be forgotten. Let's see how deep the memory hole goes.
Re:Hash collision in Apple NeuralHash model by mda on Wednesday August 18, 2021 @01:43PM (#28224641)
"Steve Jobs Apple"? I don't think Jobs would give a damn about people crying about Apple's decisions. I don't know why people thinks he would be a smidgen better than whoever managing apple after him.
Re:Hash collision in Apple NeuralHash model by ksec on Wednesday August 18, 2021 @04:55PM (#28227021)
Because he actually understand privacy better than 99.9% of people in Silicon Valley. He is also a product person who understand how users feel. Compare to current Apple which is "still" trying to give me a technical explanation of what is and what's not.
Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @11:23AM (#28222434)
Steve Jobs would have implemented this in secret and never told us at all, same as they already did for iCloud photos so many years ago. That would have been a far better approach than today’s Apple is taking. Oh well.
Re:Hash collision in Apple NeuralHash model by dmix on Wednesday August 18, 2021 @12:25PM (#28223523)
There’s a significant leap from implementing something server side to on the consumer handheld devices themselves. Even if it’s just similar software it is regardless much more serious.

I personally thought the unencrypted backups was enough of a death-knell as it provides everything on your phone but anything with real-time on device access is always a gold mine for surveillance hawks.

Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @01:17PM (#28224330)
It's serious to you, but CSAM scanning is irrelevant to 99.99999% of Apple's customers, and Jobs would never have allowed an announcement about migrating CSAM scanning from uploads to the cloud to the device uploading to the cloud. That's an implementation detail that wouldn't be relevant to discuss with outsiders. Instead, I expect he would have presented it in a closed session to the FBI and/or Congress. Never to the press, not like this.
Re:Hash collision in Apple NeuralHash model by neolog on Wednesday August 18, 2021 @01:46PM (#28224673)
> CSAM scanning is irrelevant to 99.99999% of Apple's customers

How long until an group of governments tells Apple to add Tank Man to the list?

Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @03:09PM (#28225793)
Why would they bother? That's a terrible way to approach it.

Just pass legislation requiring in-country datacenters that can be decrypted by thoughtcrime enforcers, like Russia and China are doing. Trying to get this done via a CSAM list that's absurdly closely audited would be a huge waste of time and not provide any significant benefit, and if such a request were ever made public, would likely result in severe political and economic sanctions.

That's what everyone's missing in this argument. There's no need to be all underhanded and secretive when you can just pass laws and conduct military-backed demands upon companies using those laws. Trying to exploit the CSAM process would be a horrifically bad idea, and would result in public exposure and humiliation, rather than the much more useful outcome that simply passing a law would provide.

Re:Hash collision in Apple NeuralHash model by neolog on Wednesday August 18, 2021 @05:12PM (#28227238)
Without the technology deployed, Apple can (and did) say they don't have the ability to break into users' phones.

If Apple deploys on-phone scanning, governments can just tell Apple to support a new list. It won't be the NCMEC CSAM list. It will be a "public safety and security" list. I wouldn't rule out underhandedness either. [1]

[1] https://www.nytimes.com/2020/07/01/technology/china-uighurs-...

Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @05:31PM (#28227439)
Apple already has technology deployed to perform binary file scans of every file on macOS and iOS, and the ability to at any time release signatures for those scans, that are very difficult for normal users to prevent updates for. They've had that for years, maybe even a decade by now, and so far to date we have seen no abuse of that list.

How is Apple's new CSAM list somehow increasing the chances of Apple going rogue, given that we've all been living with that risk for the past X years?

Re:Hash collision in Apple NeuralHash model by neolog on Wednesday August 18, 2021 @05:45PM (#28227582)
What technology are you referring to as already deployed?
Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @06:02PM (#28227722)
For macOS, I'm talking about XProtect and MRT. I don't know the exact subsystem names on iOS, apologies.

https://support.apple.com/guide/security/protecting-against-...

Each system is closed source, provides a mechanism for checking content signatures against files on disk, and is thought to report telemetry to Apple when signatures are found.

How is CSAM scanning new and different from those existing closed-source systems?

Re:Hash collision in Apple NeuralHash model by neolog on Wednesday August 18, 2021 @06:39PM (#28228043)
I'd say the primary differences are that the CSAM scan is a perceptual hash rather than a regular file hash, and that the technical infrastructure of the CSAM system is designed from the ground up to be used against (rather than for) the user and report them individually to authorities for violation.
Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @06:50PM (#28228135)
Do you have an alternate design in mind that is both "used for the user", and is also effective at reporting CSAM content being uploaded from the device, without allowing CSAM abusers to opt-out of that reporting? I haven't been able to come up with anything myself, but maybe you've had better luck.
Re:Hash collision in Apple NeuralHash model by neolog on Wednesday August 18, 2021 @08:27PM (#28228948)
I can only point to other people who know more than me.

https://stratechery.com/2021/apples-mistake/ is a smart tech commentator

https://www.nytimes.com/2021/08/11/opinion/apple-iphones-pri... are two security/encryption experts

Re:Hash collision in Apple NeuralHash model by hughrr on Wednesday August 18, 2021 @02:25PM (#28225224)
Exactly this. I see lots of people saying that Apple are forced to implement something via legislation as if it’s an excuse for it.

If they want to do business in China they will be forced by their legislation.

My entire argument is don’t build the mechanism.

Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @03:19PM (#28225903)
China forced Apple by legislation to implement new iCloud algorithms for assigning China-region user data into China-hosted datacenters. Most countries, unlike the US, are not constrained by a requirement to only exercise previously-built mechanisms and not create new ones, in response to government demands. If China decides to require Apple to censor non-CSAM content on-device, they will do so whether or not CSAM content fingerprinting exists. That China has not done so is because they benefit greatly from Apple's manufacturing and sales and do not wish to create a diplomatic incident with Apple.
Re:Hash collision in Apple NeuralHash model by cyanite on Wednesday August 18, 2021 @04:44PM (#28226856)
> China-hosted China-decryptable datacenters.

China hosted, yes, but Apple denies China-decryptable, so that’s speculation unless you have a good source.

Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @04:59PM (#28227069)
Nope, that's just me remembering wrong. Deleted those two words, thanks for the correction :)
Re:Hash collision in Apple NeuralHash model by tandav on Wednesday August 18, 2021 @01:26PM (#28224455)
until ios source code is closed all privacy claims is only backed by trust. They easily can do whatever they want if you're not compiling from source. There's no way to ensure your data is not leaving your iphone/mac with some "system" network requests.
Re:Hash collision in Apple NeuralHash model by cyanite on Wednesday August 18, 2021 @04:45PM (#28226865)
Security researchers and hackers routinely look at the code on the device, though.
Re:Hash collision in Apple NeuralHash model by ksec on Wednesday August 18, 2021 @04:48PM (#28226915)
Well Steve Jobs was the one that resisted PRISM and gave the middle finger to NSA.
Re:Hash collision in Apple NeuralHash model by floatingatoll on Wednesday August 18, 2021 @04:56PM (#28227028)
NSA PRISM was and illegal and warrantless text analysis and search system for most communications on the Internet, collected all communications without bothering to filter at all, and had no protections in place to prevent people from randomly searching and reading content out of human curiosity.

Apple's CSAM implementation protects the user against algorithm defects, does not expose the user to legal trouble until they have at least 30 human-verified visual matches of CSAM content, and occurs on-device using a small set of confirmed and audited signatures to ensure that CSAM scanning requires a central system only for verifying the unverified, blurred, positive matches.

I would hesitate to compare Steve Jobs' views on PRISM to his likely views on something that is so clearly opposed to it in so many ways. So I do not yet understand your viewpoint that Apple CSAM scanning and PRISM would have been treated equally by Steve. Help me understand?