News for hackers. Stuff that matters.
Re:SpiderKeeper: Admin UI for scrapy/open source scrapinghub by jsmith99 on Saturday March 07, 2020 @02:58PM (#22513661)
Scrapy doesn't run javascript so it can't scrape client rendered content at all. There are projects that combine scrapy with a headless browser or javascript engine.

There are no comments on this comment yet.