News for hackers. Stuff that matters.
Re:My AI skeptic friends are all nuts by dabockster on Tuesday June 03, 2025 @03:07PM (#44173477)
You can get 90%+ of the way there with a tiny “coder” LLM running on the Ollama backend with an extension like RooCode and a ton of MCP tools.

In fact, MCP is so ground breaking that I consider it to be the actual meat and potatoes of coding AIs. Large models are too monolithic, and knowledge is forever changing. Better just to use a small 14b model (or even 8b in some cases!) with some MCP search tools, a good knowledge graph for memory, and a decent front end for everything. Let it teach itself based on the current context.

And all of that can run on an off the shelf $1k gaming computer from Costco. It’ll be super slow compared to a cloud system (like HDD vs SSD levels of slowness), but it will run in the first place and you’ll get *something* out of it.

Re:My AI skeptic friends are all nuts by macrolime on Tuesday June 03, 2025 @04:27PM (#44174346)
Which MCPs do recommend?
Re:My AI skeptic friends are all nuts by FinalDestiny on Thursday June 05, 2025 @02:34PM (#44194427)
DesktopCommander and Taskmaster are great to start with. With just these, you may start to see why OP recommends a memory MCP too (I don’t have a recommendation for that yet)
Re:My AI skeptic friends are all nuts by esaym on Tuesday June 03, 2025 @04:52PM (#44174603)
Why don't you elaborate on your setup then?
Re:My AI skeptic friends are all nuts by xandrius on Tuesday June 03, 2025 @06:13PM (#44175359)
Because you can look it easily up. Jan, gtp4all, etc.

It's not black magic anymore.