Re:Formatting floating point numbers
by wbl on Friday June 14, 2019 @10:12AM
(#20183149)
What is the relative error in 0.1? What is the relative error in 0.2? And what is the relative error in the sum? That's how one thinks seriously about floats.
[ Parent
| on HN ]
That's a really succinct way of putting it. I would add a less catchy companion to highlight the affect of the formatter:
What is the relative error in 0.1? What is the relative error in 0.3? And what is the relative error in the sum? And whats the relative error in 0.4?
(i.e if they are the same it will be obscured by the formatter).