News for hackers. Stuff that matters.

A comment on Energy-Efficient Llama 2 Inference on FPGAs via High Level Synthesis.

Re:Energy-Efficient Llama 2 Inference on FPGAs via High Leve... by kernelsanderz on Friday May 10, 2024 @04:07AM (#40316496)
What's really cool, is that this was built on Karpathy's llama2.c repo https://github.com/karpathy/llama2.c

A great example of the unexpected things that happen when put great code into the commons.

I bet Andrej never expected anything like this when he released it.

[ Parent | on HN ]
Re:Energy-Efficient Llama 2 Inference on FPGAs via High Leve... by samus on Friday May 10, 2024 @05:24PM (#40323936)
Keep in mind that Andrej is probably holding back a lot of optimizations for the sake of keeping the code comprehensible!
[ Parent | on HN ]