That is a good point. Although, in principle Proof of Stake could use any number of algorithms, and thus the trust could be based on something other than who has the most resources. In general for distributed systems, trusting based on reputation is a common idea. "Circles of trust" was how the original Ripple concept was explained.

The important question is not which of these ideas is better than each other, but which is better than existing infrastructure.