> I don't see why that couldn't coincide with a decrease in subsidies. In an ideal world, we could even redirect that money towards the poor - potentially making up for the impact to food banks.

This seems true but irrelevant. The claim that things would be better for everyone, were X accompanied by policies Y and Z, is not a real defence of X unless you have good reason to believe that it really will be accompanied by Y and Z.