News for hackers. Stuff that matters.

A comment on Llama.cpp 30B runs with only 6GB of RAM now. Parent comment

Re:Llama.cpp 30B runs with only 6GB of RAM now by wnoise on Sunday April 02, 2023 @03:04PM (#35413971)
It's true nothing forces or forbids this, but some languages/toolings/communities/ecosystems encourage that more than others though.
[ Parent | on HN ]

There are no comments on this comment yet.