Only buying indexes is different from only buying one index.
For example, someone willing to pay a $1 premium for an indexed stock.
It is trading at $5 today and becomes indexed, so you pay $6 for it. It leaves the index so you can only sell it for $5.
It doesn't matter how many times you average it, it is still a source of loss.
If you only have one index, going from position 11 to 10 increases the value of the stock. But if you have a lot of indices, all these effects should average out to basically zero, since that stock might be in thousands of indices, and a drop out from a single index will only have a marginal effect.
This is a long way of saying that a limited number of indices is an assumption of the hypothetical.
It would break the market if everyone invested in indexes because nobody is paying attention to fundamentals.
If there are a huge number of indexes and people are diligently picking between them, that is basically the same thing as being active investors.
Where would those gains come from? It can't be that the index funds are matching the market and the active investors are doing better. Someone has to be doing worse in that situation.