The criticism isn't "inflation should be based on NYC rent." The criticism is "the basket of goods weighs nice-to-haves too highly, and important needs like rent/healthcare/education too low".
So while inflation (as officially defined by the consumer price index) is technically low, "real" inflation (as experienced in impacts to citizens cashflow) is significantly higher across the board.
Homeowners don't experience higher housing prices unless they decide to buy a new home. (Though they might have to pay higher property taxes.)
Renters might not experience higher rent right away, either due to rent control, or having a landlord that doesn't raise prices as fast as the market.
If you are going say "but the CPI does measure things that way" you are right. It has been well observed that the CPI had been looking more and more like a cost of living index for years (eg, the hedonics changes). This is why the GDP deflator is used more often to gauge inflation now, except it only come out quarterly with the GDP figures.
This is why we calculate these numbers using a broad basket of various goods and assets.