The legislative branch did give these agencies permission to take the actions they have, when those agencies were founded. The fact that SCOTUS disagrees doesn't make them right.

Also, outcomes matter. If before a ruling, a group of people had rights, and after a ruling those people have fewer rights, the cause of the loss of those rights is the ruling.