News for hackers. Stuff that matters.
Re:LLaMA Now Goes Faster on CPUs by tgma on Monday April 01, 2024 @04:12AM (#39891829)
Either https://lmstudio.ai (desktop app with nice GUI) or https://ollama.com (command-like more like a docker container that you can also hook up to a web UI via https://openwebui.com) should be super straightforward to get running.
Re:LLaMA Now Goes Faster on CPUs by tchvil on Monday April 01, 2024 @10:18AM (#39894414)
Thank you for letting me know it was possible on an M1. I'll try all this now.