Re:When Double Precision Is Not Enough
by bluetwo on Saturday March 19, 2022 @06:13PM
(#30738024)
I'll admit being lost in some of the math here but I wonder perhaps naively, if a language like Julia, which does fractions as fractions, would handle it better.
[ Parent
| on HN ]
Re:When Double Precision Is Not Enough
by salty_biscuits on Saturday March 19, 2022 @06:37PM
(#30738190)
It's really just a floating point precision issue. Even if you represented the input matrix as a rational elementary type the output eigenvalues would be a subset of the reals and calculated as being floating point.
You could get around it if you had a special matrix type where you knew you were definitely going to get rational eigenvalues and you could dispatch on that type.