News for hackers. Stuff that matters.

A comment on Why do we use R rather than Excel?. Parent comment

Re:Why do we use R rather than Excel? by FabHK on Wednesday July 14, 2021 @09:55AM (#27833019)
That's an issue inherent in floating point computations with fixed precision (such as IEEE 754).

  julia> 1e20 + 1000 - 1e20
  0.0

  julia> 1e20 + 10000 - 1e20
  16384.0

  Python 3.9.6 (default, Jun 28 2021, 19:24:41) 
  >>> 1e20 + 1000 - 1e20
  0.0
  >>> 1e20 + 10000 - 1e20
  16384.0
[ Parent | on HN ]

There are no comments on this comment yet.