Re:Llama2.java: Karpathy's llama2.c ported to Java
by mike_hearn on Tuesday August 08, 2023 @03:12PM
(#37054049)
Hey man, awesome stuff. Surely any JIT compiler will struggle to vectorize something using IntStream.range, though? Looking at matmul, I'd not expect that to be auto-vectorized. The Panama API can be used to do a matmul vectorization, too bad it seems to never launch.
[ Parent
| on HN ]
Re:Llama2.java: Karpathy's llama2.c ported to Java
by mwcampbell on Tuesday August 08, 2023 @04:56PM
(#37055336)
Panama is now in its third preview in the soon-to-be-released JDK 21:
Is there any indication that it won't go from there to a final release soon?
Re:Llama2.java: Karpathy's llama2.c ported to Java
by mike_hearn on Wednesday August 09, 2023 @03:53AM
(#37059803)
That's only for the FFI I think. The vector API has been incubated six times now and is waiting for Valhalla :(