If your comparison function returns a float instead of a binary value, then you don't need to match against every possible image. Instead you just return how much each image is "similar" to the given image. A simple approach is to use cross correlation for the similarity.