Re:Octopuses caught on camera throwing things at each other
by krick on Thursday November 10, 2022 @09:18PM
(#33556566)
Can you give an example of "arcane black magic heuristics"? I cannot imagine, what weird rules you could even come up with, aside from the normal "sensible" ones you already listed.
[ Parent
| on HN ]
Re:Octopuses caught on camera throwing things at each other
by KMag on Wednesday November 23, 2022 @12:36PM
(#33722146)
I was on a different team, but my third-hand knowledge from 20 years ago (notably, before deep learning became mainstream, even at Google) was that Google crawl scheduling had a bunch of heuristics to guess at the update frequency of a given page. The probability that a page has changed since you last crawled it is an important factor in the expected utility of crawling it now.
As I mentioned, I expect that even more arcane heuristics, in the form of ML models, has largely or completely replaced the hand-written heuristics.