Re:Show HN: A self-updating list of the most current useragents
by jeroenhd on Saturday December 17, 2022 @05:42PM
(#34033045)
How do you control for the faked user agents scrapers use? A bad scraper will be much more common in your logs than a well-behaved browser, after all.
[ Parent
| on HN ]
Re:Show HN: A self-updating list of the most current useragents
by stayml on Saturday December 17, 2022 @06:17PM
(#34033302)
I filter out any user agents that are invalid, but there's no way to see which are real or faked. The access logs include the useragent of every single site visitor - not only errors/bad actors.