News for hackers. Stuff that matters.
Re:Firefox removes core product support for RSS/Atom feeds by aftbit on Friday October 12, 2018 @04:46PM (#18204597)
Headless Chrome sets a different User Agent than normal Chrome. Once you get past that, there are trickier ways to distinguish bots from humans. These range from access pattern analysis (who visits hundreds of URLs per day but never clicks anything?) to differences in the JavaScript and rendering behavior of headless Chrome from normal Chrome. Developing a truly human-like bot that can pass modern anti-bot logic is very hard, and that's without even dealing with IP reputation or ReCaptcha.
Re:Firefox removes core product support for RSS/Atom feeds by jjeaff on Friday October 12, 2018 @10:52PM (#18206131)
Even if you manually browse lots of pages in Google or Amazon, you will eventually be presented with a captcha because it thinks you are a bot.