Your best bet is also to spend a lot more on insulation. Combined insulation and efficient heating/cooling will keep your house comfortable. Overspending on one will not be as good.

You can also do heat pump for 90% of the time and emergency heat as oil/gas/wood stove.