Re:Llama.cpp 30B runs with only 6GB of RAM now
by baq on Saturday April 01, 2023 @03:21PM
(#35403218)
Python is the practical language for when you do your cpu intensive tasks outside of it as a feature, since the GIL isn’t a problem with io parallelism.
You’d do better complaining about still nascent, compared to alternatives, async support or lack of jit in the official implementation.
You’d do better complaining about still nascent, compared to alternatives, async support or lack of jit in the official implementation.