News for hackers. Stuff that matters.
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by asail77 on Wednesday September 10, 2025 @11:46AM (#45199421)
A good model for planner seems pretty important, what models are best?
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by saqadri on Wednesday September 10, 2025 @12:05PM (#45199722)
OP here -- I think the general principle I would recommend is using a big reasoning model for the planning phase. I think Claude Code and other agents do the same. The reason this is important is because the quality of the plan really affects the final result, and error rates will compound if the plan isn't good.
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by haniehz on Wednesday September 10, 2025 @11:53AM (#45199563)
based on the article, it seems like a good reasoning model like gpt5 or opus 4.1 might be good choices for the planner. I wonder if the gpt oss reasoning models would do well
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by koakuma-chan on Friday September 12, 2025 @01:15PM (#45224344)
Gemini 2.5 Pro is also a great reasoning model, I still prefer it over GPT 5
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by luckydata on Friday September 12, 2025 @03:30PM (#45225753)
Gemini is great, it's just incredibly clumsy at tool use and that's why it fails so often in practice. I'm looking forward to the next version, it will for sure address it, it's a big issue internally too (I'm a recent xoogler).
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by koakuma-chan on Friday September 12, 2025 @03:54PM (#45226025)
I'm excited for the next version!
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by PantaloonFlames on Friday September 12, 2025 @04:26PM (#45226354)
Can you elaborate on “clumsy at tool use”?
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by luckydata on Friday September 12, 2025 @09:17PM (#45228475)
have you ever witnessed how sometimes Gemini makes multiple attempts at writing a file only to give up and start chanting "I'm worthless...".

That's tool use failure :)

Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by reachableceo on Friday September 12, 2025 @04:46PM (#45226571)
Yes it really is horrible at using tools. Codex is way better (even better than Claude code ). Gemini is great at doing audits and content (though I’ve switched to codex for everything all in one).
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by diggan on Friday September 12, 2025 @02:06PM (#45224845)
Personally been using GPT-OSS-120b locally with reasoning_effort set to `high` and it blows pretty much every other local model out of the water, but takes a lot of time for it to eventually do a proper content reply. But for fire-and-forget jobs like "Create a well-researched report on X from perspective Y" it works really well.
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by cyberninja15 on Friday September 12, 2025 @03:45PM (#45225926)
what machine are you running GPT-OSS-120B on? I'm currently only able to get GPT-OSS-20B working on my macbook using Ollama
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by ilovefood on Friday September 12, 2025 @01:42PM (#45224602)
Great write-up! Gives me a few ideas for a governance bot that I'm working on. Thanks for sharing :)
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by diggan on Friday September 12, 2025 @02:05PM (#45224828)
I gotta say, having white blurry blobs of something in the background floating behind white/grey text maybe wasn't the best design-choice out there.

None the less, I tried to find the actual APIs/service/software used for the "search" part, as I've found that to be the hardest to actually get right (at least for as-local-as-possible usage) for my own "Deep Research Agent".

I've experimented with Brave's search API which worked OK, but seems pricey for agent usage. Currently experimenting with using my own (local) YaCy instance right now, which actually gives me higher quality artifacts at the end, as there are no rate-limits and the model can do hundreds of search calls without me worrying about the cost. But it isn't very quick at picking up some stuff like news and more, otherwise works OK too.

What is the author doing here for the actual searching? Anyone else have any other ideas/approaches to this?

Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by Zetaphor on Friday September 12, 2025 @03:37PM (#45225837)
Self host an instance of SearXNG[1] either locally or on a remote server with a simple docker container and use its JSON API [2]. You have to enable the JSON API in the config manually [3].

[1] https://docs.searxng.org/admin/installation-docker.html#inst...

[2] https://docs.searxng.org/dev/search_api.html

[3] https://github.com/searxng/searxng/discussions/3542

Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by saqadri on Friday September 12, 2025 @04:10PM (#45226204)
Thanks for sharing, this looks great! Do they have an MCP server? It should be easy to wrap around their JSON API but I couldn't see MCP support in the repo/docs.
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by Zetaphor on Friday September 12, 2025 @04:49PM (#45226605)
Not that I'm aware of, but it's an extremely simple API. It's should be really easy to wrap into an MCP
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by saqadri on Friday September 12, 2025 @03:14PM (#45225580)
Haha, I didn't have control on the blog website, just the content. The readme and code is the ultimate source of truth (and easier to read):https://github.com/lastmile-ai/mcp-agent/blob/main/src/mcp_a...

So the core idea is the Deep Orchestrator is pretty unopinionated on what to use for searching, as long as it is exposed over MCP. I tried with a basic fetch server that's one of the reference MCP servers (with a single tool called `fetch`), and also tried with Brave.

I think the folks at Jina wrote some really good stuff on the actual search part: https://jina.ai/news/a-practical-guide-to-implementing-deeps... -- and how to do page/url ranking over the course of the flow. My recommendation would be to do all that in an MCP server itself. That keeps the "deep orchestrator" architecture fairly clean, and you can plug in increasingly sophisticated search techniques over time.

Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by jimmySixDOF on Sunday September 14, 2025 @11:45AM (#45240684)
I'd be interested if you did any comparison testing to the langchain project which was, at least a month ago, the top open source approach

https://huggingface.co/spaces/Ayanami0730/DeepResearch-Leade...

Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by saqadri on Monday September 22, 2025 @12:00PM (#45335332)
Thanks for sharing this! We've reached out to the benchmark owners are are going to get our deep research agent benchmarked soon.
Re:Show HN: A Deep Research MCP Agent (and pitfalls I hit al... by mbil on Friday September 12, 2025 @09:47PM (#45228660)
I'm using mcp-agent and have tried the orchestrator workflow pattern[0]. For deep research I'm having mixed results. As far as I can tell, it's not using prompt caching[1] with Anthropic models, nor the gpt-5 responses API[2], which is preferable to the completions API. The many MCP tools from a handful of servers eat up a lot of context. It doesn't report progress, so it'll just spin for minutes at a time without meaningful indication. Mostly it has been high cost and high latency without great grounding in source facts. I like the interface overall, but some of the patterns and examples were convoluted. I'm aware that mcp-agent is being worked on, and I look forward to improvements.

[0]: https://docs.mcp-agent.com/workflows/orchestrator

[1]: https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

[2]: https://platform.openai.com/docs/guides/migrate-to-responses