News for hackers. Stuff that matters.

A comment on Llama.cpp: Full CUDA GPU Acceleration. Parent comment

Re:Llama.cpp: Full CUDA GPU Acceleration by Kelteseth on Tuesday June 13, 2023 @03:56PM (#36316026)
So it now uses the GPU after some help, but it is not that much faster on my Vega VII than on my 5950x 16 core cpu :/
[ Parent | on HN ]

There are no comments on this comment yet.