News for hackers. Stuff that matters.
Re:Perplexity is using stealth, undeclared crawlers to evade... by trhway on Monday August 04, 2025 @10:28PM (#44793706)
With all the crypto development how come we haven't got to

  HTTP/1.1 402 Payment Required
  WWW-price: 0.0000001 BTC, 0.000001 ETH, 0.00001 DOGE
> You are less likely to participate in discussion

you (or AI on your behalf) paid instead. Many sites would probably like it better.

Re:Perplexity is using stealth, undeclared crawlers to evade... by dns_snek on Tuesday August 05, 2025 @02:53AM (#44795038)
It's not a development problem, it's an adoption problem. Publishers are desperate to sell us on a $20+/month subscription, they don't want to offer convenient affordable access to single articles.
Re:Perplexity is using stealth, undeclared crawlers to evade... by skydhash on Tuesday August 05, 2025 @06:48AM (#44796471)
$20/month would be nice if it wasn't a tier with less ads. I want no ads, and full-text rss feeds (because I want to use my clients to read). It's like how Netflix refuses to build a basic search and filter, or Spotify refuses to an actual library manager. They don't want you in control of your consumption.
Re:Perplexity is using stealth, undeclared crawlers to evade... by autoexec on Tuesday August 05, 2025 @12:20PM (#44800067)
If people were forced to pay for websites by the http request people would demand that websites stop loading a ton of externally hosted JS, stop filling sites with ads, and would demand that websites actually have content worth the price.

There are so many links I click on these days that are such trash I'd be demanding refunds constantly.

Re:Perplexity is using stealth, undeclared crawlers to evade... by trhway on Tuesday August 05, 2025 @02:20PM (#44802070)
>There are so many links I click on these days that are such trash

That is why AI "summarization" becomes a necessary intermediate layer. You'd not see nor trash nor ads, and thus the payment instead of being exposed to the ads. AI saves the Internet :)