Re:SpiderKeeper: Admin UI for scrapy/open source scrapinghub
by jsmith99 on Saturday March 07, 2020 @02:58PM
(#22513661)
Scrapy doesn't run javascript so it can't scrape client rendered content at all. There are projects that combine scrapy with a headless browser or javascript engine.
[ Parent
| on HN ]
There are no comments on this comment yet.