Perhaps the de-duplicator as described in the OP could operate on posts within the same X-hour period (where X is 24-48 somewhere). I agree with you that automatically referencing previous postings of the same content would be great for older duplicates.