News for hackers. Stuff that matters.
Re:Formatting floating point numbers by firethief on Sunday June 16, 2019 @01:55PM (#20196863)
That construction can turn any residual N digits out into a first digit difference. It wouldn't matter without making comparisons with tolerance way under the noise floor of the dataset. But yes, you have technically invented a situation that differs from that real-world anecdote in regard to that property, in an extremely literal interpretation.
Re:Formatting floating point numbers by civility on Monday June 17, 2019 @12:53PM (#20204896)
And here I was, worried I might be tedious or pedantic, trying to argue that floating point is just not that simple. You've really outdone me in that regard.