Re:Llama.cpp: Full CUDA GPU Acceleration
by nologic01 on Tuesday June 13, 2023 @07:42AM
(#36308752)
> Yes, and it's not so bad.
In the absence of alternatives its workable. Libraries like eigen or armadillo help a lot. But Python with numpy has been extremely popular for a good reason.
In the absence of alternatives its workable. Libraries like eigen or armadillo help a lot. But Python with numpy has been extremely popular for a good reason.