News for hackers. Stuff that matters.
Re:Show HN: I'm making an AI scraper called FetchFox by marcell on Wednesday September 04, 2024 @02:36AM (#41442529)
Scraping is semi-controversial, but in this case it's just a user with a Chrome extension visiting the site. LinkedIn has lots and lots of shady patterns around showing different results to Google Bot vs. regular users to encourage logged in sessions. Many other sites like Pinterest and Twitter/X employ similar annoying patterns.

Imo, users should be allowed to use automation tools to access websites and collect data. Most of these sites thrive off of user generated content anyways, for example Reddit is built on UGC. Why shouldn't people be able to scrape it?

Re:Show HN: I'm making an AI scraper called FetchFox by kaoD on Wednesday September 04, 2024 @03:38AM (#41442905)
In hopes of saving someone a search: UGC = User Generated Content.
Re:Show HN: I'm making an AI scraper called FetchFox by firtoz on Wednesday September 04, 2024 @04:29AM (#41443225)
If let's say I built an extension that allows people to scrape things on demand and the extension sends that data also to my servers, removing PII in the process, would that be allowed?