Show HN: Eat the News – A text extraction playground for global RSS feeds

Re:Show HN: Eat the News – A text extraction playground for ... by bhl on Friday March 13, 2020 @04:37PM (#22570703)

Articles given via RSS feeds usually don't contain ads, right? Might it be possible to use content with no ads from RSS and the same content from the home webpage with ads to build a text extraction model that works beyond RSS?

[ Parent | on HN ]

Re:Show HN: Eat the News – A text extraction playground for ... by imduffy15 on Friday March 13, 2020 @09:07PM (#22572266)

There are AI solutions that can work on the HTML and manage to avoid the ads. Checkout https://blog.scrapinghub.com/extracting-clean-article-html-w...

[ Parent | on HN ]

Re:Show HN: Eat the News – A text extraction playground for ... by gumby on Friday March 13, 2020 @05:07PM (#22570888)

That is typically not the case. Some are just a headline or a headline and a short paragraph of text (the most common). Some are the full text without HTML (thus no ad links -- mostly indie blog pages). Some are the actual page.

[ Parent | on HN ]