News for hackers. Stuff that matters.
Re:Llama.cpp: Full CUDA GPU Acceleration by NBJack on Tuesday June 13, 2023 @09:54AM (#36310270)
The right combo for Nvidia/CUDA/RandomPythonML library is a nightmare at times. This is especially true if you want to use older hardware like a Tesla M40 (dirt cheap, still capable). And your maker hopefully be with you if you if you tried to use your distro's native drivers first.

It's fair to say part of the blame is on Nvidia, but wow is it frustrating when you have to find eclectic mixes.

There are no comments on this comment yet.