News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by bsenftner on Wednesday November 29, 2023 @06:08PM (#38466622)
Super duper impressed. I've run llamafile-server-0.1-llava-v1.5-7b-q4 against the tests I need to pass for use in a project, and this passes them all, vision queries too. This is gonna change quite a bit, strategy-wise for quite a few people.

There are no comments on this comment yet.