News for hackers. Stuff that matters.
Re:Can I Run AI locally? by AstroBen on Friday March 13, 2026 @01:19PM (#47367141)
Ollama or LM Studio are very simple to setup.

You're probably not going to get anything working well as an agent on an M2 MacBook, but smaller models do surprisingly well for focused autocomplete. Maybe the Qwen3.5 9B model would run decently on your system?

Re:Can I Run AI locally? by jrmg on Friday March 13, 2026 @01:50PM (#47367452)
Right - setting up LM studio is not hard. But how do I connect LM Studio to Copilot, or set up an agent?
Re:Can I Run AI locally? by NortySpock on Friday March 13, 2026 @02:06PM (#47367618)
I tried the Zed editor and it picked up Ollama with almost no fiddling, so that has allowed me to run Qwen3.5:9B just by tweaking the ollama settings (which had a few dumb defaults, I thought, like assuming I wanted to run 3 LLMs in parallel, initially disabling Flash Attention, and having a very short context window...).

Having a second pair of "eyes" to read a log error and dig into relevant code is super handy for getting ideas flowing.

Re:Can I Run AI locally? by AstroBen on Friday March 13, 2026 @02:03PM (#47367580)
It looks like Copilot has direct support for Ollama if you're willing to set that up: https://docs.ollama.com/integrations/vscode

For LM Studio under server settings you can start a local server that has an OpenAI-compatible API. You'd need to point Copilot to that. I don't use Copilot so not sure of the exact steps there

Re:Can I Run AI locally? by brcmthrowaway on Friday March 13, 2026 @01:55PM (#47367505)
Basically LM Studio has a server that serves models over HTTP (localhost). Configure/enable the server and connect OpenCode to it.

Try this article https://advanced-stack.com/fields-notes/qwen35-opencode-lm-s...

I'm looking for an alternative to OpenCode though, I can barely see the UI.

Re:Can I Run AI locally? by AstroBen on Friday March 13, 2026 @02:09PM (#47367648)
Codex also supports configuring an alternative API for the model, you could try that: https://unsloth.ai/docs/basics/codex#openai-codex-cli-tutori...