News for hackers. Stuff that matters.
Re:LLaMa running at 5 tokens/second on a Pixel 6 by zodester on Wednesday March 15, 2023 @01:25PM (#35171725)
It uses the ARM NEON extensions to the instruction set for SIMD (as far as I understand).

There are no comments on this comment yet.