News for hackers. Stuff that matters.

Show HN: ArXiv-txt, LLM-friendly ArXiv papers

https://www.arxiv-txt.org/

Just change arxiv.org to arxiv-txt.org in the URL to get the paper info in markdown

Example:

Original URL: https://arxiv.org/abs/1706.03762

Change to: https://arxiv-txt.org/abs/1706.03762

To fetch the raw text directly, use https://arxiv-txt.org/raw/abs/1706.03762, this will be particularly useful for APIs and agents

( 11 comments | 2 points | on HN )
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by lgas on Thursday February 20, 2025 @05:05AM (#43112989)
It just extracts the abstracts?
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by jerpint on Thursday February 20, 2025 @06:59AM (#43113655)
For now , yes - abstracts and other metadata
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by rrekaf on Thursday February 20, 2025 @04:12PM (#43120262)
do you plan on adding descriptions of figures and tables?
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by jerpint on Thursday February 20, 2025 @08:22PM (#43122946)
will probably focus on getting the text out of the papers first, figures might be a good next step after that
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by jmartin2683 on Thursday February 20, 2025 @09:38AM (#43115191)
This would be awesome wrapped in an MCP server/tool call :)
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by jerpint on Thursday February 20, 2025 @12:42PM (#43117774)
whoa - i haven't yet played with MCP - might be a good first project!
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by westurner on Thursday February 20, 2025 @09:41AM (#43115227)
If you train an LLM on only formally verified code, it should not be expected to generate formally verified code.

Similarly, if you train an LLM on only published ScholarlyArticles ['s abstracts], it should not be expected to generate publishable or true text.

Traceability for Retraction would be necessary to prevent lossy feedback.

Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by sbpost on Thursday February 20, 2025 @10:58AM (#43116259)
The example you give doesn't seem to work - the raw txt does not have authors.
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by jerpint on Thursday February 20, 2025 @08:23PM (#43122955)
you're right - I hadn't noticed! I fixed it now, thanks for pointing it out
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by cchance on Friday February 21, 2025 @03:27PM (#43132536)
Was super excited that it was going to be the actual papers, kinda cool but just being abstracts doesn't go very far, good luck getting the papers working thats gonna be pretty cool once working, then to feed it all into a vector db XD
Re:Show HN: ArXiv-txt, LLM-friendly ArXiv papers by owalerys on Wednesday February 26, 2025 @03:03PM (#43187585)
Really clean API design, I'm a fan!