The Supreme Court's job is to decide what laws are legal, not what they think the law ought to be. Deciding what the law ought to be is Congress's job.
Do you suppose that nine Supreme Court justices might have considered and already dismissed your three-word argument in their lengthy decision on the subject?
And the argument is that money isn't speech.