Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Continue with LocalAI: An alternative to GitHub's Copilot that runs locally. Parent comment
n_gpu_layers should also be set to anything other than 0 (default). I don't think the exact number matters for metal, but I use 128.
There are no comments on this comment yet.
n_gpu_layers should also be set to anything other than 0 (default). I don't think the exact number matters for metal, but I use 128.