News for hackers. Stuff that matters.

A comment on Bfloat16 support coming to Apple's Metal and PyTorch [video]. Parent comment

Re:Bfloat16 support coming to Apple's Metal and PyTorch [video] by dlewis1788 on Monday July 03, 2023 @02:18PM (#36576872)
Someone commented below that with enough batchnorm/layernorm/etc. and/or gradient clipping you can manage it, but BF16 just makes life easier if you can live without some precision.
[ Parent | on HN ]

There are no comments on this comment yet.