This is true, but my October honeymoon in Puerto Rico - right in the middle of hurricane season - was amazing. Perfect weather combined with miles and miles of empty beaches on the island of Vieques all to ourselves. Airfare, car rental, hotel, meals for a week - it cost us right around $1k.

I mention this because even during the several months of hurricane season the weather is usually fine.