Yes, the point is that it's often unsafe to eat a food item that has gone mouldy, even after removing the visibly mouldy bits.

The implication of the "people used to die for no reason" line is that 'we always did x in the old days' isn't necessarily a good argument for the safety of x. The link between action and consequence is often obscure, especially for the class of actions that usually turn out fine.