There are many lots that don't get built on because the cost of construction is higher than the value of the home once built. I have done the math on a number of such lots, and the permitting fees have been roughly the amount to tip the scales. Add to that the one year minimum build time due to at least 4-6 months of bureaucratic delays, and it just becomes unfeasible.