News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by eyegor on Friday December 01, 2023 @09:16PM (#38495214)
Hmm, I just assumed people knew about it. Submitted https://news.ycombinator.com/item?id=38495176

Self hosted 6.7b model is phenomenal in my experience, I actually prefer it to chatgpt a lot of the time. Similar quality code but fewer disclaimers and #todo in my experience. Gpt4 is still a bit better at coding but not by much and it's much slower for me.

There are no comments on this comment yet.