https://www.nh.gov/osi/energy/energy-nh/fuel-prices/index.ht...
You can see that as of June 2, measured at $ per MMBTU (million BTU):
Natural Gas $8.31
Oil $17.62
Propane $32.93
Wood pellets $21.92
Resistive electric $48.84
Air src heat pump $18.74
The fossil fuels are all measured assuming 80% heating efficiency, whereas for propane or natural gas you might well have a high efficiency unit up to 97% which gains you a bit more savings.These prices may vary depending on location and also I think natural gas isn't that common in NH as it's a mostly rural state.
So if fuel prices and the amount of useful heat usage stayed the same, then your bill should be 1.03/1.25≈82% of what it was before. If your bill is "less than half" then something else must have changed.
Any modern boiler (gas or oil) will almost certainly be cold start, so it only fires when there's a call for heat. This alone probably saves a gallon of oil a day at least.
It's really hard to predict where prices are going to be in a year, because you really have to predict how well the oil industry can predict future demand in this environment. If they shut down too much production and then demand comes back there could be a price spike. If they expect a quick recovery and are wrong, prices could remain on the floor for a good while.
According to the NH page, that price was June 2. For the Commonwealth of MA, as of late May it was $2.07 on average and it's down 33% on last year:
https://www.mass.gov/service-details/massachusetts-retail-he...
You can see it has dropped from $3.04 on Jan 7 2020.
Natural gas is roughly $15 for 1 million BTU. There are 3412 BTU in a kwhr, so if you heated resistively, you'd need 293 kwhr to get 1 million BTU.
In my area, which I feel has pretty high electricity cost, we pay $.24 per kwhr, so that'd be $70.
Therefore, you need a 70/15 (4.666) COP for your heat pump to match natural gas by price. My understanding is that that would be an unusually high number for cold weather conditions.