I always worry that if I do something like this it'll cause the malicious person to spend extra effort and attention on a real attack.

Because that's what I'd do if I hit a honeypot...