Like you prioritize not hearing activists talk about their priorities, and they don't care about your priorities and thus talk about theirs.
Is griping about this going to change anything? Of course not.
That's not a challenge to this line of thinking, it's just another way of wording the exact same thing.
On the other hand, the fact that I can choose which struggles I engage with, and am able to avoid ones I don't want to involve myself in is absolutely a privilege. Someone who may need an abortion may not be able to avoid caring about that issue. Someone less economically secure may not be able to avoid worrying about unemployment or healthcare policy. There's countless similar examples.
You can absolutely acknowledge that you don't have the spoons/time/interest to deeply invest yourself in every social cause or issue. But you should also recognize that there are tons of people who also don't have the spoons/time/interest either, but have to anyway because the issue affects them and they can't afford to ignore it either.
The challenge I have with this line of thinking is that you can literally apply it to any and all issues. The number of problems in the world are effectively infinite but our ability to take a meaningful position is finite and extremely limited. The default state of being is to not have taken a position on something.
To insinuate that someone is privileged for not getting involved is a cudgel and a guilt-tripping tool being used against someone who doesn't share the same priorities as you do. It strikes me as "if you're not with us, you're against us", a sentiment that used to be loathed in the early 2000's but is now accepted and expected.