News for hackers. Stuff that matters.
Re:Is Apple checking images we view in the Finder? by runjake on Saturday January 21, 2023 @02:54PM (#34469706)
Caveat:

"Images viewed in apps supporting VLU have neural hashes computed, and those are uploaded to Apple’s servers to perform look up and return its results to the user, as previously detailed[1]." (but not for CASM reasons)

1. https://eclecticlight.co/2022/03/25/how-visual-look-up-works...

Re:Is Apple checking images we view in the Finder? by btown on Saturday January 21, 2023 @03:43PM (#34470296)
A bit hard to believe that VLU's NeuralHashes aren't also passed through CSAM detection, when NeuralHashes were first announced to the world in the context of CSAM detection: https://www.apple.com/child-safety/pdf/CSAM_Detection_Techni...

That said, to reiterate the OP, there's no evidence that VLU executes when using Finder or QuickLook alone.

Re:Is Apple checking images we view in the Finder? by mftb on Saturday January 21, 2023 @04:04PM (#34470514)
Are you sure? Because in a prior article on the same source your parent linked it would appear that it is being used with QuickLook[0].

"While VLU is taking place, the image being looked up is opened in the floating window of a QuickLook preview."

[0]https://eclecticlight.co/2022/03/23/how-visual-look-up-works...

Re:Is Apple checking images we view in the Finder? by btown on Saturday January 21, 2023 @04:39PM (#34470849)
Hmm, there is some ambiguity in the author's writing style. I interpreted what you quoted above as "if you are in Safari.app or Preview.app and activate VLU explicitly, it displays the image in a QuickLook window." The author does say in https://eclecticlight.co/2023/01/18/is-apple-checking-images... that:

> Although the original description given was ‘Finder browsing’, for some that might include the display of images as QuickLook Previews, by selecting the image and pressing the Spacebar... [The process triggered from this] is consistent with the briefer task used in Live Text, and quite different from VLU. There is thus no evidence of the generation of neural hashes or any search query by PegasusKit typical of the later stages of VLU...

> Local images that are viewed in QuickLook Preview undergo normal analysis for Live Text, and text recognition where possible, but that doesn’t generate identifiers that could be uploaded to Apple’s servers.

Re:Is Apple checking images we view in the Finder? by mftb on Saturday January 21, 2023 @04:51PM (#34470971)
Understood. My own personal take-away, is that even with all the digging those folks have done it is not possible to know what Apple is actually doing. Which kind of reinforces your original point in the comment that I was responding to.
Re:Is Apple checking images we view in the Finder? by ribosometronome on Saturday January 21, 2023 @07:13PM (#34472490)
In the comments on the main article, the author says:

>It’s perhaps worth pointing out here that VLU is nothing like Apple’s proposals for CSAM recognition. The neural hashes used to look up images in VLU are ‘low resolution’. They’re good for distinguishing specific images of paintings, breeds of dog and cat, and so on. But – as you can read in my detailed account of the proposed method – they fall far short of what would have been required to detect CSAM. Another big difference is that initial CSAM detection was intended to be performed locally, using a database of ‘positive’ neural hashes stored locally. Apple recognised that looking them up online wasn’t feasible, but that’s exactly what VLU does, because it works differently, with a much larger database and forming less robust and more inaccurate matches. So VLU ≠ CSAM detection, not by a long way.

I'm still not super sure it couldn't be misused, though. A tool that is good enough to be able to reliably detect things like dog breeds (as the author also points out) seems like it should reliably enough also do things like detect drug paraphernalia, pictures of tankman, banned religious symbols, or whatever thing that people were more worried about being oppressed by a potentially authoritarian government. That's also why it seems, to me, like the more worrying vector for an authoritarian government to force abuse wasn't the higher resolution neural hashes matched against known images but the ML labeling of images for searchability.

Re:Is Apple checking images we view in the Finder? by hnaccy on Saturday January 21, 2023 @03:52PM (#34470375)
Is there any way to disable VLU?

It sounds like anytime I open an image in Preview it sends hashes to apple?

Re:Is Apple checking images we view in the Finder? by runjake on Saturday January 21, 2023 @03:53PM (#34470389)
FTA:

"VLU can be disabled by disabling Siri Suggestions in System Settings > Siri & Spotlight, as previously explained[1]."

1. https://eclecticlight.co/2022/04/08/how-to-enable-use-and-fi...

Re:Is Apple checking images we view in the Finder? by randyrand on Saturday January 21, 2023 @04:06PM (#34470528)
what is VLU?
Re:Is Apple checking images we view in the Finder? by MBCook on Saturday January 21, 2023 @04:13PM (#34470601)
Visual look up. I believe it’s the thing where Apple will tell you if something is a tree or a plant or a dog or whatever. And you can click on it and it hopefully tells you what kind like lab vs poodle vs Great Dane.
Re:Is Apple checking images we view in the Finder? by SkyMarshal on Saturday January 21, 2023 @04:15PM (#34470618)