Show HN: ArXiv Feed – The easiest way to keep up with AI research

Posted by subtech on Tuesday January 17, 2023 @01:40PM
from the show-hn dept.

https://arxiv-feed.vercel.app/

Hey HN!

I've always found it hard to keep up with the latest AI research, so I built Arxiv Feed!

https://arxiv-feed.vercel.app/

It's basically a feed of AI research papers + a one-liner explaining what problem its solving, etc.

You can also click on any paper to get a TL;DR.

Right now, I've only indexed a few hundred large language model papers, but will expand to indexing AI papers in other topics.

Thinking of also adding a way for people to up-vote/down-vote papers.

Would love to hear any thoughts/feedback! :D

Thanks!

( 17 comments | on HN )

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by gardenfelder on Tuesday January 17, 2023 @02:41PM (#34417605)

Appears to be built with https://github.com/vercel/vercel

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Tuesday January 17, 2023 @03:15PM (#34418225)

Yup!

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by rando_person_1 on Tuesday January 17, 2023 @04:05PM (#34419105)

The TL;DRs are generated or hand written? Are they powered by an LLM?

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Tuesday January 17, 2023 @04:19PM (#34419344)

GPT-3! Thank god I don't have to hand write them lol.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by cloudking on Tuesday January 17, 2023 @05:42PM (#34420558)

How are you getting past the token limit?

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by pilotneko on Wednesday January 18, 2023 @08:46AM (#34426528)

Likely only summarizing the abstracts.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Wednesday January 18, 2023 @11:04AM (#34428417)

Yup only abstracts for now, but I think it should be possible to parse the paper PDF to extract just the approach + experiment results w/ GPT-3 (despite 4k token limit). Will add this soon.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by pilotneko on Thursday January 19, 2023 @08:49AM (#34440199)

I would suggest sentence tokenization followed by clustering to pull the most representative sentence from each cluster. Unless you want to go abstractive, that is.

If you run into issues with the token limit, there are some nice architectures for handling longer inputs (e.g., Longformer, Reformer, etc.).

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Friday January 20, 2023 @05:38PM (#34461086)

interesting ideas, thanks!

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by 2muchclout on Tuesday January 17, 2023 @05:11PM (#34420152)

Did you build this for a school project? I go to a college where this was submitted as a senior capstone and was wondering if this is the same project.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Tuesday January 17, 2023 @05:19PM (#34420270)

Nah, I just built this as a fun personal project.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by Twirrim on Tuesday January 17, 2023 @07:34PM (#34421662)

I honestly have the complete opposite problem. Trying to get a feed from arxiv that doesn't include artificial intelligence whitepapers is a pain. Very little of the content is even remotely interesting or practical, and it sneaks in to almost every single topic/category.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Wednesday January 18, 2023 @11:04AM (#34428422)

lool

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by janalsncm on Wednesday January 18, 2023 @05:58AM (#34425364)

This is incredible! Just a couple of things.

The first time I opened it the app worked fine. But now it just says “loading”. I’d debug more if I wasn’t on mobile.

RSS feed. Please add one. In fact if you could email me the top papers every week it would make a great newsletter.

Upvote/downvote is less useful than comments imo.

Let me know if you’d like to add search. That is my specialty.

That is all.

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Wednesday January 18, 2023 @11:03AM (#34428402)

Ah I think the loading error might be due to many people loading the site at the same time. The site should work now!

Newsletter coming, and will definitely add filtering by tags/topics + search!

Comments sounds like a good idea as well!

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by aaroncrow on Thursday January 19, 2023 @01:26PM (#34443680)

Love it! Was thinking of making this myself, you saved me the trouble!

[ Parent | on HN ]

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Friday January 20, 2023 @01:12PM (#34457192)

yooo thanks! Got some exciting updates shipping super soon (e.g., search, email newsletter, auto-freshing a new list of papers on every page refresh, etc.)

[ Parent | on HN ]