News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by chaorace on Friday March 31, 2023 @07:54PM (#35395401)
Python has the misfortune of competing against JS in this arena, which just so happens to have the most obsessively optimized JIT ever.
Re:Llama.cpp 30B runs with only 6GB of RAM now by Max-Limelihood on Monday April 03, 2023 @06:57PM (#35432517)
In ML? No, the best competition for Python in ML is... well, it's either C++ or Julia, depending on how you define "competition," given Python is effectively a glorified C++ interface.