Re:Yahoo is making a return to search
by saurik on Monday January 30, 2023 @08:22PM
(#34589532)
A public git repository is definitely crawlable. Google seems to have given up actively going out of their way to index things that are hard to crawl as they got so big and important it was easier to just tell people "thou must do X or we won't index you and you want to be indexed", but increasingly the content I want to find is in weird little silos.
[ Parent
| on HN ]
There are no comments on this comment yet.