So as you rightly hypothesize, the "first" bit of insulation is more important than the next bit. Going from R-1 to R-2 decreases energy loss by 50%, going from R-2 to R-3 decreases it by a further 30%, R-3 to R-4 by a further 20%, etc.
So for my example with a 40ºF difference between inside and outside, if that wall assembly were 120sq ft, the original wall with R-6.15 would be losing 780btu/hr. The 13% improvement in R-Value from the first example would reduce energy costs by 10% (700btu/hr of energy loss), the 35% improvement would reduce costs by 25% (578btu/hr). It's strictly better to increase r-value but the highest leverage impacts come from the bottom.
https://www.greenbuildingadvisor.com/article/all-about-u-fac...
So R-Value represents the thermal resistance and U-Value the transmittance but you can easily take the reciprocal of one to get the other (e.g. my R-2 window is just a U-0.5).
My MPG reference was an eye-opening moment for me -- the US uses MPG which is really backwards from what you care about (in the same way that R-value and U-value are). So increasing your mileage from 10mpg to 12mpg saves exactly as much gasoline as increasing your mileage from 30mpg to 60mpg. This is plainly obvious when you consider gallons per 100 miles, [10->8.3] & [3.3->1.7].