News for hackers. Stuff that matters.

A comment on In Defense of Pure 16-Bit Floating-Point Neural Networks. Parent comment

Re:In Defense of Pure 16-Bit Floating-Point Neural Networks by em3rgent0rdr on Monday May 22, 2023 @10:47PM (#36039204)
Yes, that is what I was getting at. Floating point hardware with fewer bits have less complexity and so have smaller transistor die area and power consumption.
[ Parent | on HN ]
Re:In Defense of Pure 16-Bit Floating-Point Neural Networks by WithinReason on Tuesday May 23, 2023 @03:29AM (#36041084)
If I recall correctly, area/power is proportional to the square of the length of the mantissa.
[ Parent | on HN ]