Aha, that's an interesting position and one I completely agree with. It points to the core of the matter:

It lifts the individual food-items towards a more socioeconomic, structuralistic philosophy of society. Eating the Snickers bar is communicating "I do not care about my food-choices". It is about carelessness and sloth, a stigmatic act.

And even though there is a kernel of truth in your argument, it introduces more dogma into the whole food situation.