News for hackers. Stuff that matters.
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by rjeli on Saturday July 20, 2019 @07:19PM (#20488913)
I wonder why they chose it over facebook’s 8 bit posit: https://code.fb.com/ai-research/floating-point-math/
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by Veedrac on Saturday July 20, 2019 @10:30PM (#20489625)
‘(8, 1, alpha, beta, gamma) log’ isn't a posit; it just shares the encoding of the exponent.
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by lonelappde on Saturday July 20, 2019 @07:24PM (#20488923)
bfloat16 is very similar to traditional IEEE 754 floating point, and Google+Intel already have history building hardware for it.
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by kristianp on Saturday July 20, 2019 @08:25PM (#20489170)
What does the "int8/32" mean in that paper?
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by msclrhd on Sunday July 21, 2019 @04:34AM (#20490480)
4x8-bit values in a 32-bit value? SIMD does this to perform an operation on 4 8-bit values in a single 32-bit register. There are other configurations, IIRC.

https://en.wikipedia.org/wiki/SIMD#Software

Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by hedgehog on Saturday July 20, 2019 @09:10PM (#20489335)
In that context it's likely 8 bit operands and a 32 bit accumulator.
Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by somethingnot on Saturday July 20, 2019 @07:32PM (#20488955)
bfloat16 sounds like it could be supported with minimal changes to existing floating point units, maybe with just some improved microcode.

FB's approach on the other side requires entirely redesigned and separate execution units. That's harder to justify, that silicon will remain dark for non-DL usage.

Re:Intel Prepares to Graft Google’s Bfloat16 onto Processors by mjevans on Sunday July 21, 2019 @03:02AM (#20490283)
It looks like a standard 32 bit float but with the mantissa truncated to fit in to 16 bits of storage.

I imagine it still keeps most of the performance benefits since it's eliminating around 2/3rds of the longest binary component.