News for hackers. Stuff that matters.
Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @03:07PM (#40691958)
Because if I run a server - at my own expense - I get to use information provided by the client to determine what, if any, response to provide? This isn’t a very difficult concept to grasp.
Re:Perplexity AI is lying about their user agent by nradov on Saturday June 15, 2024 @03:13PM (#40692002)
I'm having difficulty grasping the concept. Only a fool would trust any HTTP headers such as User-Agent sent by a random unauthenticated client. Your expenses are your problem.
Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @03:27PM (#40692098)
… and I have absolutely no obligation to provide any particular response to any particular client.

Parsing, rendering, and trusting that the payload is consistent from request to request is your problem. You can connect to my server, or not. I really don’t care. What you cannot do is dictate how my server responds to your request.

Re:Perplexity AI is lying about their user agent by nradov on Saturday June 15, 2024 @03:37PM (#40692171)
Sure. So just return an HTTP 4XX response to requests you don't like. What's the problem?
Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @03:49PM (#40692253)
Or, I return whatever content I want, within the bounds of the law, based on whatever parameters I decide. What's your problem with that? Again, connect to my server or don't. But don't tell me what type of response I'm obligated to provide you.

If I think a given request is from an LLM training module, I don't have any legal obligation whatsoever to return my original content. Or a 400-series response. If I want to intersperse a paragraph from Don Quixote between every second sentence, that's my call.

Re:Perplexity AI is lying about their user agent by int_19h on Saturday June 15, 2024 @03:57PM (#40692294)
But nobody is arguing for that. Instead, what the server owners want is to mandate the clients connecting to them to provide enough information to reliably reject such connections.
Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @04:12PM (#40692389)
There are literally people in this thread arguing that it is "unethical" to discriminate based on user agent.
Re:Perplexity AI is lying about their user agent by skeledrew on Saturday June 15, 2024 @05:03PM (#40692675)
This argument of freedom seems applicable on both sides. A site owner/admin is free to return whatever response they wish based on the assumed origin of a request. An LLM user/service is free to send whatever info in the request that elicits a useful response.
Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @05:12PM (#40692739)
I don’t have any problem with that.
Re:Perplexity AI is lying about their user agent by SpaghettiCthulu on Saturday June 15, 2024 @07:16PM (#40693408)
> What you cannot do is dictate how my server responds to your request.

The client is under no obligation to be truthful in its communications with a server. Spoofing a User-Agent doesn't "dictate" anything. Your server dictates how it responds all on its own when it discriminates against some User-Agents.

Re:Perplexity AI is lying about their user agent by Too on Sunday June 16, 2024 @01:49AM (#40694959)
With enough sophistication and bad intent, at some point being untruthful to a server falls under computer intrusion laws, eg using a password that is not yours. I don't believe spoofing user agent would be determinant for any such case though.

Even redistributing secret material you found on an accidentally open S3 bucket, without spoofing UA, could be considered intrusion if it was obvious the material was intended to be secret and you acted with bad intent.

Re:Perplexity AI is lying about their user agent by tomjen3 on Saturday June 15, 2024 @04:26PM (#40692484)
This is a technical fact.

It is also a technical fact that a client can send any header it wants.

Re:Perplexity AI is lying about their user agent by marcus0x62 on Saturday June 15, 2024 @04:35PM (#40692520)
I think that is implied in my comment. You can send me whatever request you want, within the bounds of the law. I get to decide, within the bounds of the law, how I respond. Demanding I provide a particular response to every client (and what the parent commenter and others seem to be arguing for) is where I take exception.