News for hackers. Stuff that matters.
Re:Formatting floating point numbers by civility on Saturday June 15, 2019 @09:22PM (#20193245)
So umm, more than a "difference in the realm of 6-8 significant digits"?
Re:Formatting floating point numbers by firethief on Sunday June 16, 2019 @01:55PM (#20196863)
That construction can turn any residual N digits out into a first digit difference. It wouldn't matter without making comparisons with tolerance way under the noise floor of the dataset. But yes, you have technically invented a situation that differs from that real-world anecdote in regard to that property, in an extremely literal interpretation.
Re:Formatting floating point numbers by civility on Monday June 17, 2019 @12:53PM (#20204896)
And here I was, worried I might be tedious or pedantic, trying to argue that floating point is just not that simple. You've really outdone me in that regard.