> So why do people heat that way?

I'm not sure of the historical costs, but benefits are reducing dependencies on particular energy sources, reducing global warming, and heat pumps not being invented yet (long ago).

There is legislation along the lines of houses built here must be connected, just like they must also be connected to the sewage system.