Investment is the most important thing to growing wealth but also we can't just have an economy of only investment, someone needs to actually buy things in the economy.
Typically the lower/middle end spending keep the consumer economy afloat with larger spending on consumer products that make those investments worth it because there is demand. You have to have people buying for demand, to then invest in supply, demand always comes first or else wealth doesn't invest.
Further, wealth simply cannot buy enough to keep the whole economy afloat and wealthy people invest to retain more wealth not necessarily return it to the economy, whereas poor/middle range players spend to survive. When there is a market crash, wealth stops investing, poor/middle keeps on buying which is key. When there is inequality and only investment, downturns get harsher and harsher eradicating demand and thus eradicating investment opportunities.
This creates a situation where the same $1 has less value to a poor person because it has interest paid attached, and $1 to a rich person will have interest/investment gained attached. It is that difference, as well as starting funds/wealth for investment, that creates the exponential growth for wealth and the enormous advantage wealth gives to market actors when inequality is high. Wealth grows at like O(n log n) or better, while poor wealth shrinks sometimes at less than O(1)
Combine that with rich people on average spending less of their overall wealth into the consumer economy (not just investments or hoarding it during down markets -- a problem that exacerbates crashes) and you have a system that will get much worse. Policy is failing currently at getting money to move to all parts of the economy and the velocity of money has fallen off a cliff and is in a freefall due to the hoarding/inequality that has grown since 2000 intensely [1].
[1] https://fred.stlouisfed.org/series/M2V