The only thing talking about privilege does is create a game of one-upmanship where everyone tries to tear others success down.

I would argue everyone is privileged to some degree. Hell, being born in a first world country makes you way more privileged than most of the world.

And yes, there is luck involved, but hard work plays a massive role in outcomes. To ignore that is folly.