That's an astute observation. It always strikes me as jarring when the speaker leaves off the "not" in the clause.... but on the rare occasions it happens, it's always about a chance in society/convention which is clearly not considered a positive.