News for hackers. Stuff that matters.
Re:Octopuses caught on camera throwing things at each other by krick on Thursday November 10, 2022 @09:18PM (#33556566)
Can you give an example of "arcane black magic heuristics"? I cannot imagine, what weird rules you could even come up with, aside from the normal "sensible" ones you already listed.
Re:Octopuses caught on camera throwing things at each other by KMag on Wednesday November 23, 2022 @12:36PM (#33722146)
I was on a different team, but my third-hand knowledge from 20 years ago (notably, before deep learning became mainstream, even at Google) was that Google crawl scheduling had a bunch of heuristics to guess at the update frequency of a given page. The probability that a page has changed since you last crawled it is an important factor in the expected utility of crawling it now.

As I mentioned, I expect that even more arcane heuristics, in the form of ML models, has largely or completely replaced the hand-written heuristics.