News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by jart on Wednesday November 29, 2023 @09:03PM (#38468388)
That's a nice model that fits comfortably on Raspberry Pi. It's also only a few days old! I've just finished cherry-picking the StableLM support from the llama.cpp project upstream that you'll need in order to run these weights using llamafile. Enjoy! https://github.com/Mozilla-Ocho/llamafile/commit/865462fc465...
Re:Llamafile lets you distribute and run LLMs with a single ... by Hedepig on Thursday November 30, 2023 @12:48PM (#38476515)
Thank you for this :)