A lot of people think there is a fixed amount of wealth, so if your slice of the pie is larger than theirs you are being greedy and taking from the them. I don't know why incorrect ideas like this one persist, but it seems to keep coming back again and again.
I don't think it's you specifically. He grinds the same axe about most people who make money, are involved with finance, and capitalism in general. Tends to think building significant amounts of wealth is "irrationally selfish", and that we could collaborate instead of compete because there's enough to go around. Smart guy in most ways, but a bit of an idealist and not up to date on the historical record of ownership-by-everyone vs. individual, private ownership.