Re:What happened to TheNumbers.com
by pverheggen on Thursday July 23, 2026 @03:54PM
(#49027164)
There's been an explosion of vibe-coded scrapers that behave poorly and ignore robots.txt. Presumably OP disallowed crawling of the search endpoint for the reason stated (that crawling it would result in endless permutations of search filters.)
[ Parent
| on HN ]
There are no comments on this comment yet.