The difference is that in an economic down turn, I am protected by my vast wealth, where a poor person has no savings because they spend every dollar they have on necessities.

A consumption tax is always regressive.