News for hackers. Stuff that matters.
Re:Patriot Missile Floating Point Software Problem Led to De... by justinl33 on Thursday January 04, 2024 @05:00AM (#38865193)
Why doesn't it wrap around?
Re:Patriot Missile Floating Point Software Problem Led to De... by nzentzis on Thursday January 04, 2024 @05:10AM (#38865268)
The problem is that there aren’t enough digits of precision to represent the answer. The exact answer would be 999999.0000001, but let’s say you only have space to store six significant digits. The exact answer is way more precise, so you need to round it to the nearest representable value, 999999.

Floating-point rounding issues are the same thing but with binary digits instead of decimal ones.