Re:1.15 * 100 = 149.99999999999999 except in Ruby
by celias on Friday December 16, 2011 @03:19PM
(#3362146)
The "mindless" paper from William Kahan has a nice discussion of roundoff errors:
http://www.cs.berkeley.edu/~wkahan/Mindless.pdf
The ~wkahan path has more papers.
[ Parent
| on HN ]
There are no comments on this comment yet.