Sure, but they don't cost the city anything, either. They sit empty and the city collects money. Meanwhile, the owners aren't even there and use zero city services. Should those taxes be higher? Fine with me! But these apartments are a low-salience/high-visibility distraction. They have hardly anything to do with the issues in the broader housing market.

Actually they do. They influence the mindset and strategy of developers.