> also, there should be some limits to who gets to do highly specialized things

That limit exists. It is called supply and demand. There is no need to artificially limit this, if other people want to enter the market.