On the contrary, it would be easier because you'd only need to take a mortgage on the improvement value, the land itself would be very cheap. Sure, you'd have to pay ground rent to the government but that would simply offset other taxes you would've owed regardless.