Re:Windows Calculator invalid input with 10^x function
by gabriel34 on Thursday August 02, 2018 @07:18PM
(#17676246)
Using this we can actually predict the smallest exponent that fails for other bases:
(the calculated exponent for two is actually 0.144270, but since it ends in zero the first failure occurs at 0.144271)
[ Parent
| on HN ]
Re:Windows Calculator invalid input with 10^x function
by imran3740 on Thursday August 02, 2018 @10:07PM
(#17676848)
Just checked, calc fails at 11^0.41703 (curiously not at 41703, but 41704, maybe a floating point thing). Maybe it changes base to e and uses the Taylor series for e^x, but fails if x is too precise for what it expects?