News for hackers. Stuff that matters.
Re:Web Search API by daft_pink on Monday October 05, 2026 @12:38PM (#49967140)
Wow, will they offers some sort of reduce a web page into a markdown file api as welL so we can get full web pages at reduced token sizes?
Re:Web Search API by moealmaw on Monday October 05, 2026 @01:18PM (#49967673)
They already have that[0] it’s called Markdown for Agents and it works on any URL

[0] https://developers.cloudflare.com/fundamentals/reference/mar...

Re:Web Search API by alexey-salmin on Monday October 05, 2026 @04:46PM (#49970456)
We do have that in Exa search:

* Extraction of main content from HTMLs, the index stores markdown representations (free of headers/footers/sidebars/menus etc)

* Serving highlights picking the most relevant part for each result to reduce token usage downstream

* Also serving dynamic highlights where we summarize all the sources at once reducing the token counts even further

see here: https://exa.ai/docs/search/highlights and https://exa.ai/docs/contents/quickstart