News for hackers. Stuff that matters.
Re:Perplexity AI is lying about their user agent by buro9 on Saturday June 15, 2024 @02:23PM (#40691624)
The companies will scrape and internalise the "customer asked for this" requests... and slowly turn the latter into the former, or just their own tool as the scraper.

No, easier to just ask a simple question: Does the company respect the access rules communicated via a web standard? No? In that case hard deny access to that company.

These companies don't need to be given an inch.

Re:Perplexity AI is lying about their user agent by lolinder on Saturday June 15, 2024 @02:26PM (#40691640)
> Does the company respect the access rules communicated via a web standard? No? In that case hard deny access to that company.

So should Firefox not allow changing the user agent in order to bypass websites that erroneously claim to not work on Firefox?

Re:Perplexity AI is lying about their user agent by rezonant on Saturday June 15, 2024 @06:53PM (#40693304)
Similarly, for sites which configure robots.txt to disallow all bots except Googlebot, I don't lose sleep about new search engines taking that with a grain of salt.
Re:Perplexity AI is lying about their user agent by elicksaur on Saturday June 15, 2024 @03:05PM (#40691942)
This is exactly the concern and there’s a lot of comments just completely ignoring it or willfully conflating.

Ad block isn’t the same problem because it doesn’t and can’t steal the creator’s data.

Re:Perplexity AI is lying about their user agent by lolinder on Saturday June 15, 2024 @03:13PM (#40692005)
> Ad block isn’t the same problem because it doesn’t and can’t steal the creator’s data.

Arguably it does. That topic has been debated endlessly and there are plenty of people on HN who are willing to fiercely argue that adblock is theft.

I happen to agree with you that adblock doesn't steal data, but I'm also completely unsure why interacting with a tool over a network suddenly turns what would be acceptable on my local computer into theft.

Re:Perplexity AI is lying about their user agent by Dylan16807 on Saturday June 15, 2024 @07:35PM (#40693490)
If that's the concern, then ask for a line in the terms and conditions that explicitly says a user-initiated request will not be saved or used for training. Don't act like the access itself is an affront.