News for hackers. Stuff that matters.
Re:Llama.cpp 30B runs with only 6GB of RAM now by baq on Saturday April 01, 2023 @03:21PM (#35403218)
Python is the practical language for when you do your cpu intensive tasks outside of it as a feature, since the GIL isn’t a problem with io parallelism.

You’d do better complaining about still nascent, compared to alternatives, async support or lack of jit in the official implementation.

There are no comments on this comment yet.