The problem most people have with "stealing" garbage are that it makes a mess (some scavengers are more polite than others -- I don't have problems in my neighborhood).

The other issue I've heard of is that the companies that collect recycling get money for them, too, and this is factored into their contract with the city. So when independent operators take the recycling it cuts into their revenue and upsets the government.