> You know it's strange because I can only ever find people arguing this when they know they won't be the ones to be out of a job.

True. You've pretty much identified the nature of special interest groups and why they have so much power.