The argument that I’ve heard is that we confuse causality. I.e., elite schools select for successful people, not that they add anything to make people successful.