News for hackers. Stuff that matters.
Re:JDK 20 will introduce float16 conversion methods by pestatije on Wednesday October 12, 2022 @06:54PM (#33184830)
32 bit floats have holes big enough, why use 16 bit ones?
Re:JDK 20 will introduce float16 conversion methods by mfiguiere on Wednesday October 12, 2022 @07:17PM (#33185067)
Float16s are useful in ML and compute workloads where they make it possible to double the throughput of vector based instructions (SIMD in CPUs / GPUs) at the cost of a lower precision which can be acceptable for many such workloads.
Re:JDK 20 will introduce float16 conversion methods by craigacp on Wednesday October 12, 2022 @09:17PM (#33186010)
Exactly so, there are a bunch of Java interfaces to native ML libraries that have some messy bit hacking to convert between fp16 and Java floats. This API along with the intrinsification (https://github.com/openjdk/jdk/pull/10500) will mean I can throw away that code and replace it with something that performs correctly and is much faster.