Exactly. YouTube has the same problem and does all kinds of things to detect this. They have the benefit of already having the media on all their own storage which they can run a map-reduce on, however.