News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by Closi on Saturday April 01, 2023 @01:58AM (#35397547)
In ML python is effectively the interface rather than the bit that is doing the heavy lifting.

The interface is designed to be easy to use (python) and the bit that is actually doing the work is designed to be heavily performant (which is C & CUDA and may even be running on a TPU).

There are no comments on this comment yet.