News for hackers. Stuff that matters.
Re:Continue with LocalAI: An alternative to GitHub's Copilot... by SparkyMcUnicorn on Tuesday August 29, 2023 @12:15PM (#37310080)
I haven't noticed any slowdowns. Maybe check that threads/n_threads is set correctly for your machine (total cores - 2. 10 cores = 8, 8 cores = 6).

n_gpu_layers should also be set to anything other than 0 (default). I don't think the exact number matters for metal, but I use 128.

There are no comments on this comment yet.