News for hackers. Stuff that matters.

A comment on Google “We Have No Moat, and Neither Does OpenAI”. Parent comment

Re:Google “We Have No Moat, and Neither Does OpenAI” by brimwats on Thursday May 04, 2023 @08:30PM (#35823931)
I haven't seen any repos or guides to using llama on that level of RAM, which is something I do have. any pointers?
[ Parent | on HN ]
Re:Google “We Have No Moat, and Neither Does OpenAI” by sjy on Thursday May 04, 2023 @08:39PM (#35823997)
Run text-generation-webui with llama.cpp: https://github.com/oobabooga/text-generation-webui
[ Parent | on HN ]
Re:Google “We Have No Moat, and Neither Does OpenAI” by kiratp on Thursday May 04, 2023 @10:11PM (#35824522)
And here are the benchmarks

https://github.com/ggerganov/llama.cpp/issues/34

[ Parent | on HN ]