News for hackers. Stuff that matters.
Re:Llamafile lets you distribute and run LLMs with a single ... by tmountain on Thursday November 30, 2023 @07:30AM (#38472686)
This is amazing. How does result quality compare to GPT4 for image analysis?
Re:Llamafile lets you distribute and run LLMs with a single ... by simonw on Thursday November 30, 2023 @08:05AM (#38472979)
It's not remotely as good as GPT-4 Vision, which isn't a big surprise consisting it's running a 4GB, 7B parameter model on your laptop, trained by a small research team.