Large companies even do it at the state level too. see[1] for an example of using an office in reno to avoid some (I don't think you can avoid some taxes like payroll, etc) taxes in California.

[1]: http://www.nytimes.com/2012/04/29/business/apples-tax-strate...