News for hackers. Stuff that matters.
Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by pilotneko on Thursday January 19, 2023 @08:49AM (#34440199)
I would suggest sentence tokenization followed by clustering to pull the most representative sentence from each cluster. Unless you want to go abstractive, that is.

If you run into issues with the token limit, there are some nice architectures for handling longer inputs (e.g., Longformer, Reformer, etc.).

Re:Show HN: ArXiv Feed – The easiest way to keep up with AI ... by subtech on Friday January 20, 2023 @05:38PM (#34461086)
interesting ideas, thanks!