If you have a condition that means you'll react very badly to something that would most other people nothing more than an upset stomach, yes. For example, if your immune system is already compromised (from HIV, cancer, etc) something as simple as mild botulism can kill you.

About 3000 people die from food poisoning every year in the US.