News for hackers. Stuff that matters.

A comment on Show HN: Imagededup – Finding duplicate images made easy. Parent comment

Re:Show HN: Imagededup – Finding duplicate images made easy by gravypod on Monday October 07, 2019 @11:16AM (#21181827)
What way is the hash represented? Have you looked at NN libraries like faiss [0] and NGT [1]? Those can quite easily handle a nearest neighbor search of 10 million vectors and, from my understanding, they turn their vectors into some kind of hash that is then searched.

[0] - https://github.com/facebookresearch/faiss

[1] - https://github.com/yahoojapan/NGT

[ Parent | on HN ]
Re:Show HN: Imagededup – Finding duplicate images made easy by tanujjain on Tuesday October 08, 2019 @03:28PM (#21196161)
The hashes are 16 character hexadecimals represented as strings. Had a quick look at the faiss package and it looks promising. Would consider it for the next versions.
[ Parent | on HN ]
Re:Show HN: Imagededup – Finding duplicate images made easy by gravypod on Tuesday October 08, 2019 @05:25PM (#21197437)
If you're interested in collaboration I'd be happy to help with a prod-focused version. My work has a need for a shardable daemon for dedup tasks. My personal email is in my description and I'm also available via [email protected].

We also have an image heavy production use case that would be able to yield some nice metrics from this tool.

[ Parent | on HN ]