News for hackers. Stuff that matters.
Re:SpiderKeeper: Admin UI for scrapy/open source scrapinghub by jatinshah on Saturday March 07, 2020 @07:19AM (#22511219)
All such admin tools use scrapyd which is not maintained and not good enough to be used in production.
Re:SpiderKeeper: Admin UI for scrapy/open source scrapinghub by gregsadetsky on Saturday March 07, 2020 @07:54AM (#22511318)
What do you recommend using instead?
Re:SpiderKeeper: Admin UI for scrapy/open source scrapinghub by rozhok on Saturday March 07, 2020 @02:05PM (#22513338)
One of the companies I've worked for developed in-house solution (with some domain-specific stuff).

I've had to write some kind of admin tool for one of my clients.

And then I've used to start another project with scrapy and I feel like I need to develop another one tool for scrapyd management :)