News for hackers. Stuff that matters.

A comment on Llama.cpp: Full CUDA GPU Acceleration. Parent comment

Re:Llama.cpp: Full CUDA GPU Acceleration by leoh on Tuesday June 13, 2023 @01:43AM (#36305944)
I wonder if having a shared cache would make this more easeful. fwiw nix does that.
[ Parent | on HN ]

There are no comments on this comment yet.