> Why are we all upset about short-term rentals when so many real estate speculators are sitting on more than 4x as many vacant properties?

I would guess partly because almost all of the short-term rentals represent either (a) previously long term rentals that are no longer available to people who live and work in that location or (b) new construction that doesn't address housing shortages.