News for hackers. Stuff that matters.

A comment on X updates its Terms to prohibit crawling/scraping of its data. Parent comment

Re:X updates its Terms to prohibit crawling/scraping of its ... by dahfizz on Friday September 08, 2023 @03:07PM (#37437982)
They have a section in the robots.txt that allows Google. They must think no other search engine matters.
[ Parent | on HN ]

There are no comments on this comment yet.