It's not a useful/interesting to just say "you're privileged, stop having thoughts/opinions".

We'd quickly just shut down all conversation ever because none of us are 8 year old british chimney sweeps covered in soot. In which case, how is the world a better place?

We can acknowledge that there's a lens where some people have privileges ("privileged isn't a binary state") and then still have a discussion about what happened.