I don't think eliminating subsidies will make housing much more affordable or accessible, but it is probably still a good idea (since tax deductions tend to favor people in higher tax brackets).
Conversely, I don't think that eliminating subsidies should really be a first priority, since I don't believe it will have a large impact, though I can't really say I know what should be beyond relaxing zoning rules.
Just create areas with relaxed zoning. Inspect only for service and building quality and let people build what they want. This will create affordable housing. The incredibly high fixed costs on development push the model towards high priced units.
A good next step would be decoupling education from housing so that the purchase or rental of a home doesn't implicitly include quasi-private school tuition. Here I see a good role for the private sector. While for-profit charter operators can be very controversial, excellent charter schools with scalable models are a necessary precondition to selling the public on a voucher system which implicitly buys you larger catchment areas and has the desirable decoupling effect. If the private sector can do that, godspeed as far as I'm concerned.