You indeed can if there are nuisance neighbors and I believe that is considered a material fact in most states. However, most documents, I believe contain a Real Estate Transfer Disclosure Statement which would have had a line indicating a "yes" if there were nuisance neighbors and it would have been up to you to ask for more details.