Various studies have found that even building expensive housing reduces rents for the entire market as it pushes people with more money into the new housing and reduces upward price pressure on older housing. Yes, it'd be good to build housing of all types. But even just building luxury apartments or whatever has an effect.