Show HN: Talk to any ArXiv paper just by changing the URL

Re:Show HN: Talk to any ArXiv paper just by changing the URL by arbitrandomuser on Thursday December 21, 2023 @01:15AM (#38717554)

I wonder if they knew that they could get html versions of the paper by just changing the link from ...arxiv.. to ar5iv..

[ Parent | on HN ]

Re:Show HN: Talk to any ArXiv paper just by changing the URL by evanhu_ on Thursday December 21, 2023 @02:00AM (#38717827)

I did try that at first, it was hard to parse through the HTML code and organize into logical sections (authors, references, abstract) and then clean up the text to prepare it optimally for chunking and embedding. Once I found GROBID I just went with that route because it handled all that for me.

[ Parent | on HN ]