News for hackers. Stuff that matters.

A comment on Intel x86 Documentation Has More Pages Than The 6502 Has Transistors (2013). Parent comment

Re:Intel x86 Documentation Has More Pages Than The 6502 Has ... by YetAnotherNick on Saturday August 05, 2023 @06:59PM (#37017062)
> Meanwhile in machine learning, people also made the switch to FP16, BF16 and INT8 largely because of the memory wall

FP16 doesn't work any faster than mixed precision on Nvidia or any other platform(I have benchmarked GPUs, CPUs and TPUs). For matrix multiplication, computation is still the bottleneck due to N^3 computation vs N^2 memory access.

[ Parent | on HN ]
Re:Intel x86 Documentation Has More Pages Than The 6502 Has ... by nextaccountic on Saturday August 05, 2023 @08:03PM (#37017525)
With FP16 you can fit twice as much weights in cache, and also fetch twice as much weights from memory

Also this depends on the size of the matrix

[ Parent | on HN ]