> He never actually said "don't buy this house" at any property we looked at, but ...

Taking hints from realtors is a skill. They are so subtle. I got exactly the same experience.