News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by dflock on Friday March 31, 2023 @10:39PM (#35396490)
The jart: the standard unit of developer.

"I've got 20 yrs experience, and I think I'm about 150 milli jarts, maybe 200 on a good day."

There are no comments on this comment yet.