News for hackers. Stuff that matters.
Re:Show HN: AI companions stack – create and host your own A... by ramesh31 on Wednesday July 12, 2023 @10:31PM (#36704371)
> It makes me wonder how long it will be until open-source locally-run AI chatbots reach the GPT-4 level. Five years? Ten?

A lot shorter than you'd think: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderb...

Latest falcon-40b-instruct is scoring higher than GPT-3 on HellaSwag benchmark already, and not far behind GPT-4: https://paperswithcode.com/sota/sentence-completion-on-hella...

Big question is what counts as "locally run". You still need about $5k worth of GPU hardware to run it.

There are no comments on this comment yet.