News for hackers. Stuff that matters.
Re:Why does Excel get 213,458,046,676,875 x 29 wrong? by db48x on Thursday April 07, 2022 @11:45AM (#30946074)
Floating–point numbers happened. Excel uses IEEE–754 floating–point arithmetic because it is fast and ubiquitous. One of the disadvantages of doing math this way is that as you get farther away from zero, the precision of the numbers goes down. It’s generally fine because most people don’t do arithmetic on 6 quadrillion and change, they do arithmetic on smaller, more approachable numbers.

Look for a way to solve your problem using software that uses unlimited–precision arithmetic instead.

There are no comments on this comment yet.