News for hackers. Stuff that matters.

A comment on Court dismisses Genius lawsuit over lyrics-scraping by Google. Parent comment

Re:Court dismisses Genius lawsuit over lyrics-scraping by Go... by mikemotherwell on Wednesday August 12, 2020 @02:56AM (#24129272)
Other way around. It was invented to stop crawling. Indexing is still technically allowed even when blocked by robots.txt from crawling.
[ Parent | on HN ]

There are no comments on this comment yet.