News for hackers. Stuff that matters.
Re:Claude Code: Now in Beta in Zed by hajile on Wednesday September 03, 2025 @02:39PM (#45119080)
I was somewhat surprised to find that Zed still doesn't have a way to add your own local autocomplete AI using something like Ollama. Something like Qwen 2.5 coder at a tiny 1.5b parameters will work just fine for the stuff that I want. It runs fast and works when I'm between internet connections too.

I'd also like to see a company like Zed allow me to buy a license of their autocomplete AI model to run locally rather than renting and running it on their servers.

I'd also pay for something in the 10-15b parameter range that used more limited training data focused almost entirely on programming documentation and books along with professional business writing. Something with the coding knowledge of Qwen Coder combined with the professionalism and predictability of IBM Granite 3. I'd pay quite a lot for such an agent (especially if it got updates every couple of months that worked in new documentation, bugfixes, github threads, etc to keep the answers up-to-date).

Re:Claude Code: Now in Beta in Zed by rolisz on Wednesday September 03, 2025 @03:47PM (#45119723)
> I'd also pay for something in the 10-15b parameter range that used more limited training data focused almost entirely on programming documentation and books along with professional business writing.

Unfortunately, pretraining on a lot of data (~everything they can get their hands on) is needed to give current LLMs their "intelligence" (for whatever definition of intelligence). Using less training data doesn't work as well for now. There definitely not enough programming and business writing to train a good model only on that.

Re:Claude Code: Now in Beta in Zed by hajile on Thursday September 04, 2025 @11:22AM (#45128298)
If the LLM isn’t getting its data about coding projects from those projects and their surrounding documentation and tutorials, what is it going to train with?

Maybe it also needs some amount of other training data for basic speech patterns, but I’d again show IBM Granite as an example that professional and to-the-point LLMs are possible.

Re:Claude Code: Now in Beta in Zed by slekker on Wednesday September 03, 2025 @03:40PM (#45119664)
Ditto, that was one of the dealbreakers for me using Zed, the Copilot integration is miles behind Cursor's
Re:Claude Code: Now in Beta in Zed by eli on Wednesday September 03, 2025 @05:10PM (#45120441)
You don't have to buy a license; the autocomplete model is open source https://huggingface.co/zed-industries/zeta

It is indeed a fine tuned Qwen2.5-Coder-7B

Re:Claude Code: Now in Beta in Zed by kilohotel on Wednesday September 03, 2025 @06:18PM (#45120982)
You can use a local model! It's in Settings in a Thread and you can select Ollama.
Re:Claude Code: Now in Beta in Zed by woodson on Wednesday September 03, 2025 @07:28PM (#45121503)
But that doesn't work for inline edit predictions, right?
Re:Claude Code: Now in Beta in Zed by woodson on Wednesday September 03, 2025 @06:21PM (#45121009)
There's an active PR providing inline edit completions via Ollama: https://github.com/zed-industries/zed/pull/33616
Re:Claude Code: Now in Beta in Zed by dcreater on Wednesday September 03, 2025 @09:28PM (#45122417)
> Ollama

You mean an locally run OpenAI API compatible server?

Re:Claude Code: Now in Beta in Zed by SquidJack on Wednesday September 03, 2025 @11:22PM (#45123178)
thats why i created myself nanocoder 0.5b FT for autocomplete in couple of days going to release a v2 version much better

https://huggingface.co/srisree/nano_coder