News for hackers. Stuff that matters.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by SilasX on Thursday August 19, 2021 @01:37PM (#28236833)
>2 in 2 trillion image pairs

Reporting the collision rate per image pair feels misleading. What you really want to know is the number of false positives per image in the relevant set, not image pair, as that's the figure that indicates how frequently you'll hit a false positive.

Re:ImageNet contains naturally occurring Apple NeuralHash co... by dhosek on Thursday August 19, 2021 @03:54PM (#28238547)
In fact, I'd argue that the collision rate per image pair is overestimating the collision rate. It's the flip side of the birthday paradox. We don't care that any two images have the same hash, we care about any image having the same hash as one in the set that we're testing against.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by SilasX on Thursday August 19, 2021 @04:35PM (#28239030)
>We don't care that any two images have the same hash,

Why not?

Re:ImageNet contains naturally occurring Apple NeuralHash co... by snet0 on Thursday August 19, 2021 @06:16PM (#28240035)
Based on the pigeonhole principle alone, it will always be the case that collisions exist. The size of the digest is very likely smaller than the size of any given image.
Re:ImageNet contains naturally occurring Apple NeuralHash co... by SilasX on Thursday August 19, 2021 @09:09PM (#28241279)
How is that relevant to whether “per image” or “Per image pair” is the right metric?

Heck, how is it relevant to anything given that hash functions avoid collisions in practice, even given the pigeonhole principle?

Re:ImageNet contains naturally occurring Apple NeuralHash co... by LodeOfCode on Friday August 20, 2021 @01:51PM (#28249155)
Those should only differ by a factor of 2 [the collision rate for an image is the number of collisions it has divided by the number of other images, so the average collision rate is the total collisions divided by n(n-1) vs. n(n-1)/2 pairs] which isn't particularly relevant at this scale
Re:ImageNet contains naturally occurring Apple NeuralHash co... by SilasX on Friday August 20, 2021 @02:05PM (#28249351)
You care about the total number of collisions, not collisions for a specific image, so they differ by a square -- hence the 1 in a trillion vs million difference.