News for hackers. Stuff that matters.
Re:With the rise of AI, web crawlers are suddenly controversial by spencerflem on Sunday February 18, 2024 @03:09PM (#39422622)
If you have residential proxies, you don't need AI to scrape via video, you have the HTML already.
Re:With the rise of AI, web crawlers are suddenly controversial by oceanplexian on Sunday February 18, 2024 @03:12PM (#39422644)
Companies spend thousands of engineering hours building elaborate mechanisms to obfuscate JS, protect APIs, apps, trigger captchas, and hide content, all of it completely powerless against the current gen of AI tools. If a human can read it, a bot can.
Re:With the rise of AI, web crawlers are suddenly controversial by Mr_P on Sunday February 18, 2024 @04:04PM (#39423318)
Those same companies often invest in accessibility for vision-impaired users. I'm not sure you need a screen capture to scrape content when the site is designed to be navigable with a screen reader.
Re:With the rise of AI, web crawlers are suddenly controversial by timthelion on Monday February 19, 2024 @02:47PM (#39433868)
Surprisingly chatgpt is not accessible via screen reader, their captcha is purely image based.