I think it's also important to remember that (to the best of my knowledge) the majority of farmland is not individually owned: it's run by large agricultural companies.

So the "land-owners," or at least, the owners of the companies that own the land, also live in the cities, and are themselves among the vastly wealthy.