News for hackers. Stuff that matters.

A comment on 16-bit math look-up tables – the unexpected power of scaled-integer math. Parent comment

Re:16-bit math look-up tables – the unexpected power of scal... by bsder on Saturday April 01, 2017 @10:31PM (#14015431)
IIRC, CORDIC has some issues as you scale the number of bits you want--you can't just run CORDIC 64 times for 64-bits of accuracy, for example.

I think the point of diminishing returns is 14-16 bits, but it's been a long time and I'd be happy to be proven wrong.

[ Parent | on HN ]

There are no comments on this comment yet.