News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by rickrollin on Friday March 31, 2023 @05:06PM (#35393662)
People have actually ran it on phones.
Re:Llama.cpp 30B runs with only 6GB of RAM now by datadeft on Sunday April 02, 2023 @02:52AM (#35407869)
This is what my comment is about. It happened much sooner than I thought.