I've only ever come out of an interview one time thinking that the guy I was talking to was a real jerk and I'd never work with him. I've come out of most pretty meh, just as you said.

For a stretch we probably did 70 interviews a year for 3-4 years spread across 9-15 participants. It seems like every year there was at least one HELL NO candidate on personality by someone.