News for hackers. Stuff that matters.
Re:I Miss RSS by vidarh on Thursday January 06, 2022 @04:33AM (#29821316)
Yeah, I ran a niche aggregator for a few years and we polled ca. 3m feeds a day. Every time a feed had an update since the last time we'd polled it we'd subtract a percentage of the polling interval with a floor of about 5m. Every time there wasn't an update we'd reduce the rate until a ceiling of about 24h. Very simple and no doubt you could do better but better wasn't necessary.

There are no comments on this comment yet.