News for hackers. Stuff that matters.
Re:Llama2.c: inference llama 2 in one file of pure C by l-m-z on Monday July 24, 2023 @07:42AM (#36846283)
Another random (self) plug for a rust version, this uses the candle ML library we've been working on for the last month and can be run in the browser. https://laurentmazare.github.io/candle-llama2/index.html The non-web version has full GPU support but is not at all minimalist :)
Re:Llama2.c: inference llama 2 in one file of pure C by ianpurton on Monday July 24, 2023 @08:32AM (#36846937)
Really nice.