If you buy a frozen pizza and it tastes terrible, should you continue buying and eating them for a week until you have enough data points?

If a single sample of corn in a shipment is contaminated with aflatoxin should you keep testing it and trying to find the good corn?

If a program corrupts your data on first use should you keep trying it on different data before rejecting it?