News for hackers. Stuff that matters.

A comment on Web Scraping in 2016. Parent comment

Re:Web Scraping in 2016 by TheCoelacanth on Wednesday August 24, 2016 @02:06PM (#12353981)
User-Agent is a SHOULD, not a MUST. There are also practically no browsers that send a non-fake User-Agent, since they almost all claim to be Mozilla/5.0.
[ Parent | on HN ]

There are no comments on this comment yet.