Re:Improving the fast inverse square root (2010)
by edynoid on Monday July 09, 2018 @07:55AM
(#17489553)
I find it quite fortunate, that they don't use it automatically. Introducing a 1e-3 relative error is quite a deal breaker for some. Not for games sure, but for science that is mostly unacceptable.
[ Parent
| on HN ]
Re:Improving the fast inverse square root (2010)
by meta_AU on Monday July 09, 2018 @11:13AM
(#17490806)
From memory, GCC does one NewtonRaphson iteration on the approximate result so the error is much lower (closer to e-9 from memory again). They don't use the approximation directly in fast-math mode.