> If people are buying whole buildings to rent out, what argument do the neighbors have for shutting down airbnb activity?

Most cities require hotels go through a permitting and approval process, usually in part to ensure things like security, parking, etc. are accounted for, and only allow them in certain areas zoned for such commercial usage.