News for hackers. Stuff that matters.

A comment on In Defense of Pure 16-Bit Floating-Point Neural Networks. Parent comment

Re:In Defense of Pure 16-Bit Floating-Point Neural Networks by bee_rider on Tuesday May 23, 2023 @03:01AM (#36040863)
If you just want the mantissa, why not use integers?
[ Parent | on HN ]
Re:In Defense of Pure 16-Bit Floating-Point Neural Networks by gumby on Tuesday May 23, 2023 @07:39AM (#36042896)
Yes, saturated fixed point or integer math. And I might have been hasty in saying you can’t do this with modern commodity hardware (here’s a paper: https://proceedings.mlsys.org/paper/2022/file/14bfa6bb14875e...)
[ Parent | on HN ]