Re:Llama.cpp: Full CUDA GPU Acceleration
by csjh on Monday June 12, 2023 @10:41PM
(#36304468)
I believe it's moreso for the (actively pursued) speed optimizations it provides. When inference is already computationally expensive any bit of performance is a big plus
[ Parent
| on HN ]
There are no comments on this comment yet.