Re:Formatting floating point numbers
by civility on Saturday June 15, 2019 @04:26PM
(#20191928)
Ugh, you're preaching to the choir. I wasn't trying to make a point about the equality operator, I was trying to make a point about x and y being completely different. I must be really bad at communicating with people.
[ Parent
| on HN ]
That's the thing: x and y are not "completely different"; they are within the tolerance one would use to compare them correctly.
So umm, more than a "difference in the realm of 6-8 significant digits"?
That construction can turn any residual N digits out into a first digit difference. It wouldn't matter without making comparisons with tolerance way under the noise floor of the dataset. But yes, you have technically invented a situation that differs from that real-world anecdote in regard to that property, in an extremely literal interpretation.