Much depends on where exactly you are and who you pay for electricity and when. For me, under PG&E pricing, the running cost for heat pump heating ends up higher than with gas. And the equipment cost is much higher.

I'll end up getting it anyway when I get an AC system someday, but it'll have to run off solar to be worthwhile.