News for hackers. Stuff that matters.

A comment on Llama.cpp 30B runs with only 6GB of RAM now. Parent comment

Re:Llama.cpp 30B runs with only 6GB of RAM now by baq on Saturday April 01, 2023 @03:18PM (#35403179)
Python has had cffi since figuratively forever, so I’m not sure why you compare native modules to P/Invoke?
[ Parent | on HN ]
Re:Llama.cpp 30B runs with only 6GB of RAM now by revelio on Sunday April 02, 2023 @06:05AM (#35408954)
Most important libraries with native components are using C extensions, not cffi.
[ Parent | on HN ]