That, there, is the hard part of the problem. You can go with acoustic hashes (like Chromaprint[1]) but even that's not 100% reliable in the face of small changes.

[1] https://en.wikipedia.org/wiki/AcoustID#Chromaprint