Re:Llamafile lets you distribute and run LLMs with a single ...
by jart on Wednesday November 29, 2023 @09:03PM
(#38468388)
That's a nice model that fits comfortably on Raspberry Pi. It's also only a few days old! I've just finished cherry-picking the StableLM support from the llama.cpp project upstream that you'll need in order to run these weights using llamafile. Enjoy! https://github.com/Mozilla-Ocho/llamafile/commit/865462fc465...
[ Parent
| on HN ]