News for hackers. Stuff that matters.
Re:Serve Markdown to AI Agents with Accept Headers by simonw on Wednesday August 26, 2026 @06:12PM (#49456630)
That used to matter to me back in the days when the best models still only accepted ~32,000 tokens, but these days even the models that run on my laptop are happy with ~100,000 and the hosted models I use take ~200,000 or more.
Re:Serve Markdown to AI Agents with Accept Headers by selcuka on Wednesday August 26, 2026 @07:34PM (#49457357)
They accept more tokens these days, but they are still more accurate with a shorter context [1].

[1] https://arxiv.org/abs/2307.03172

Re:Serve Markdown to AI Agents with Accept Headers by slowin on Wednesday August 26, 2026 @07:14PM (#49457206)
If it's one of many tool calls, I'd assume that less is more.
Re:Serve Markdown to AI Agents with Accept Headers by simonw on Thursday August 27, 2026 @04:12AM (#49461489)
The trick there is to use a subagent to read the HTML page and extract the relevant information, than dumping all that HTML into your top-level session.

That's effectively using an LLM as an HTML to markdown converter, which is both absurdly wasteful and also surprisingly inexpensive (if you use a model like GPT-5.6 Luna.)

Re:Serve Markdown to AI Agents with Accept Headers by honr on Thursday August 27, 2026 @11:51AM (#49466820)
I found HTML itself works [slightly] better with some LLMs (that I happen to frequent). So, when scraping, I parse the resulting html, simplify it, and produce simpler html contents (closer to semantics of what I guessed the real content was). Given processing tools for html are far more mature, I tend to keep content in semantic, low structure html.