News for hackers. Stuff that matters.
Re: by messe on Thursday March 26, 2026 @02:36AM (#47527267)
> It's not about bypassing access restrictions.

Yes. It is. You've just made an arbitrary choice not to define it as such.

Re: by andrew_zhong on Thursday March 26, 2026 @03:31AM (#47527617)
I will add a PR to enforce robots.txt before the actual scraping.
Re: by messe on Thursday March 26, 2026 @07:44PM (#47537319)
Or just follow web standards and define and publish your User-Agent header, so that people can block that as needed.

You're creating the wrong kind of value. I really hope your company fails, as its success implies a failure of the web in general.

I wish you the best success outside of your current endeavour.