News for hackers. Stuff that matters.

A comment on Perplexity is using stealth, undeclared crawlers to evade no-crawl directives. Parent comment

Re:Perplexity is using stealth, undeclared crawlers to evade... by dns_snek on Tuesday August 05, 2025 @02:53AM (#44795038)
It's not a development problem, it's an adoption problem. Publishers are desperate to sell us on a $20+/month subscription, they don't want to offer convenient affordable access to single articles.
[ Parent | on HN ]
Re:Perplexity is using stealth, undeclared crawlers to evade... by skydhash on Tuesday August 05, 2025 @06:48AM (#44796471)
$20/month would be nice if it wasn't a tier with less ads. I want no ads, and full-text rss feeds (because I want to use my clients to read). It's like how Netflix refuses to build a basic search and filter, or Spotify refuses to an actual library manager. They don't want you in control of your consumption.
[ Parent | on HN ]