News for hackers. Stuff that matters.

A comment on Show HN: Imagededup – Finding duplicate images made easy. Parent comment

Re:Show HN: Imagededup – Finding duplicate images made easy by throwaway_bad on Monday October 07, 2019 @02:24AM (#21178020)
People do deduplicate files to save on space, except it's usually based on exact byte match using md5 or sha256. Some don't due to privacy issues: https://news.ycombinator.com/item?id=2438181 (e.g., MPAA can upload all their torrented movies and see which ones uploaded instantly to prove that your system has their copyrighted files)

There's no way to make the UX work out for images that are only similar. Would be pretty wild to upload a picture of myself just to see a picture of my twin used instead.

But I do wonder if it's possible to deduplicate different resolutions of an image that only differ in upscaling/downscaling algorithm and compression level used (thereby solving the jpeg erosion problem: https://xkcd.com/1683/)

[ Parent | on HN ]
Re:Show HN: Imagededup – Finding duplicate images made easy by tanujjain on Tuesday October 08, 2019 @03:38PM (#21196283)
The cnn methods in the package are particularly robust against resolution differences. In fact, if it's just a simple up/downscale that differentiates 2 images, then even hashing algorithms could be expected to do a good job.
[ Parent | on HN ]