News for hackers. Stuff that matters.
Re:Ask HN: Has anyone replaced Claude/GPT with a local model... by Greenpants on Monday June 15, 2026 @05:15PM (#48547110)
I'm glad you're asking. I already started writing a blog post on how to best make use of local models. I'll share it as soon as I have a complete enough list. If anyone else reading this would like to chime in with their tips & tricks, let us know!

For the time being, off the top of my head, I'd say:

- Prompt Engineering tips & tricks apply here (like being complete in the relevant context you provide in your question, and the specific task(s) the agent should do like reasoning, modifying one file, or trying to fix a complex task all at once (not recommended)).

- If you already know which files the agent should look into, mention them to save time and potentially context.

- In my personal workflow, I write down lots of atomic TODOs needed to solve a problem. As I write it down, I'll notice assumptions I'm making, or the fact that the TODO could still be decomposed further into (atomic) subtasks.

- It's best to get a feeling yourself for how Qwen handles your repository. I noticed if I don't specify an architecture for development, it'll make quick & dirty fixes. If I don't tell it to remove debug statements, it won't. This is what was meant with "be precise" – Claude Opus might think for you and act in your best interest. Smaller Qwen models will just do what you ask them to, and no more. They have design knowledge, but you have to explicitly ask them to "activate" that part of their knowledge.

Re:Ask HN: Has anyone replaced Claude/GPT with a local model... by dotancohen on Tuesday June 16, 2026 @07:27AM (#48553559)
Thank you, that was extraordinarily helpful.

I look forward to that blog post!

Re:Ask HN: Has anyone replaced Claude/GPT with a local model... by tsss on Tuesday June 16, 2026 @09:44AM (#48555219)
But if you have to write everything down in such detail, isn't it faster to just do the task yourself?
Re:Ask HN: Has anyone replaced Claude/GPT with a local model... by thefossguy69 on Tuesday June 16, 2026 @11:15AM (#48556571)
Is there a way to be notified of your blog post on this?