fidansin
Re:Scraping Shock: Why Web Data Is Getting Too Expensive to Scrape
on Monday January 26, 2026 @09:00AM (#46765720)
I just worry we're collapsing two things into one bucket:
harder in absolute terms vs harder relative to how much real engineering effort teams are willing to invest.
Those aren't the same, and to me the distinction matters.
Re:Scraping Shock: Why Web Data Is Getting Too Expensive to Scrape
on Monday January 26, 2026 @08:47AM (#46765577)
I'm not fully convinced scraping has actually gotten harder.. It feels more like the average approach has gotten softer.
Lately everything gets framed as rising costs or unstoppable anti-bot systems, but most sites didn't suddenly become impenetrable. What changed is how people react to friction.
We're in an AI-autopilot phase now. Hit a block and the instinct is to buy more credits, switch vendors,, or let an API abstract the problem away. Meanwhile, teams still doing basic engineering work around sessions, behavior, pacing, and retries are often scraping the same targets just fine.
Honest question: have scraping costs really exploded, or have engineering standards quietly dropped as abstraction layers piled up?
Re:A macOS app that blurs your screen when you slouch
on Monday January 26, 2026 @08:44AM (#46765547)
Ok, I share my screen all the time.. not going to happen
Re:Things I've learned in my 10 years as an engineering manager
on Monday January 26, 2026 @08:42AM (#46765529)
Kinda like; You got to do, what you got to do.