You sound like all the people whom grew up in New Orleans that I spoke with when I lived there; I moved when Katrina hit. They heard the same thing. Turns out it was true, and the fact that it hadn't happened was in fact: just luck.