News for hackers. Stuff that matters.

A comment on RSS Box – RSS for websites that do not support RSS. Parent comment

Re:RSS Box – RSS for websites that do not support RSS by hinkley on Saturday June 20, 2020 @12:15PM (#23584716)
An aggregator most likely would prioritize feeds by popularity and then run most of their crawlers 24/7. Telling some users that a popular feed has new entries and not telling the free tier sounds complicated. Unless the free tier is getting a read replica of the database, in which case it’s throttled only by how far behind the read replicas get.

Prioritizing lower subscribership feeds if a smaller number of premium customers add them makes some sense though.

[ Parent | on HN ]
Re:RSS Box – RSS for websites that do not support RSS by oefrha on Saturday June 20, 2020 @12:34PM (#23584812)
Of course popular feeds are crawled constantly, and no, there’s no “telling some users that a popular feed has new entries and not telling the free tier”. But you bet services don’t want to crawl those one-subscriber feeds (e.g. some websites have personal feeds for paid subscribers) constantly for free. And RSS Box feeds apparently tend to fall in the latter category.
[ Parent | on HN ]