No, they don't have to get involved in every issue, the point is merely that inaction, or excluding yourself from politics, is itself political.

That doesn't make inaction immoral. It just means that it's not apolitical.