A lot of the tourists come for day trips via cars or cruise ships. Banning short term rentals like AirBnB might help slightly but wouldn't really solve the problem.

Living in a place where tourists outnumber permanent residents will always kind of suck no matter what. The same type of issues impact beach towns in the summer and ski towns in the winter.