Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Caffe2 adds 16 bit floating point training support on the NVIDIA Volta platform. Parent comment
https://dennisforbes.ca/index.php/2017/04/11/floating-point-...
Most desktop chips offer little advantage for FP16 (at best that the source memory footprint is smaller, maybe better cache hit rates), but newer GPUs can actually blaze. If it has the magnitude/precision needs for a task, it's a big win.
There are no comments on this comment yet.
https://dennisforbes.ca/index.php/2017/04/11/floating-point-...
Most desktop chips offer little advantage for FP16 (at best that the source memory footprint is smaller, maybe better cache hit rates), but newer GPUs can actually blaze. If it has the magnitude/precision needs for a task, it's a big win.