News for hackers. Stuff that matters.

A comment on Float Toy. Parent comment

Re:Float Toy by NavinF on Saturday August 20, 2022 @04:12PM (#32534843)
It’s by far the most popular data type for training neural networks.
[ Parent | on HN ]
Re:Float Toy by brrrrrm on Saturday August 20, 2022 @05:46PM (#32535416)
for lack of bfloat16 support
[ Parent | on HN ]
Re:Float Toy by hwers on Saturday August 20, 2022 @06:25PM (#32535688)
whats the difference between float16 and bfloat16?
[ Parent | on HN ]
Re:Float Toy by brrrrrm on Saturday August 20, 2022 @06:37PM (#32535761)
number of exponent bits. bfloat16 has a larger dynamic range with lower precision. e.g. this would be infinity in fp16 https://float.exposed/b0x5f80
[ Parent | on HN ]