Re:JDK 20 will introduce float16 conversion methods
by mfiguiere on Wednesday October 12, 2022 @07:17PM
(#33185067)
Float16s are useful in ML and compute workloads where they make it possible to double the throughput of vector based instructions (SIMD in CPUs / GPUs) at the cost of a lower precision which can be acceptable for many such workloads.
[ Parent
| on HN ]
Re:JDK 20 will introduce float16 conversion methods
by craigacp on Wednesday October 12, 2022 @09:17PM
(#33186010)
Exactly so, there are a bunch of Java interfaces to native ML libraries that have some messy bit hacking to convert between fp16 and Java floats. This API along with the intrinsification (https://github.com/openjdk/jdk/pull/10500) will mean I can throw away that code and replace it with something that performs correctly and is much faster.