You'd be surprised. The /good/ bots do this, but there's a lot of white noise garbage that simple techniques do still filter out.