Re:I replaced Firecrawl with 2,700 lines of Elixir
by mosaibah on Monday March 30, 2026 @04:00PM
(#47579042)
The 80% point is real, but the missing 20% is where Firecrawl actually earns its money rotating proxies, browser fingerprint evasion, handling sites that detect headless Chrome. If your crawling targets are mostly cooperative sites, 2700 lines of Elixir is the right call. If you ever hit Cloudflare-heavy targets at scale, that 20% becomes the whole problem.
[ Parent
| on HN ]
Re:I replaced Firecrawl with 2,700 lines of Elixir
by pipboyguy on Tuesday March 31, 2026 @03:21AM
(#47583849)
Indeed. Though rotating proxies I got from lightpanda hosted. That actually gets me more than you'd think
Re:I replaced Firecrawl with 2,700 lines of Elixir
by alexspring on Wednesday April 01, 2026 @01:51AM
(#47597283)
lightpanda is the most detectable thing ever. A custom built browser with fingerprints any serious antibot instantly blocks.