News for hackers. Stuff that matters.
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by xeckr on Tuesday November 21, 2023 @02:41AM (#38360586)
Thanks for sharing this!

I read somewhere that Mistral 7B had a similar performance to GPT-3, but it seems to be miles behind it unfortunately.

Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by vidarh on Tuesday November 21, 2023 @02:49AM (#38360635)
Remember GPT-3 != ChatGPT. I could perhaps believe it is similar to GPT-3, but it's certainly miles behind ChatGPT even with 3.5
Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by xeckr on Tuesday November 21, 2023 @02:59AM (#38360735)
I was talking about GPT-3, which I have interacted with via the developer API.

To be fair to the developers of Mistral, it's still amazing that I can run this on my computer, and it's certainly better than the first LLaMA.

Re:Self-Hosting Open Source LLMs: Cross Devices and Local De... by s369610 on Tuesday November 21, 2023 @05:30AM (#38361825)
I tried this fine tune of it https://huggingface.co/teknium/OpenHermes-2.5-Mistral-7B and was impressed. It seems to be one of the better performing models on the LLM leaderboard https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...