Re:Llama2.c: inference llama 2 in one file of pure C
by l-m-z on Monday July 24, 2023 @07:42AM
(#36846283)
Another random (self) plug for a rust version, this uses the candle ML library we've been working on for the last month and can be run in the browser. https://laurentmazare.github.io/candle-llama2/index.html
The non-web version has full GPU support but is not at all minimalist :)
[ Parent
| on HN ]