Re:How to Crawl the Web with Scrapy
by r_singh on Monday September 13, 2021 @04:33PM
(#28516503)
If you’re a web developer not really, rather than worrying about storage backendes, spiders, yielding and managing loops and items, you could just host a DRF or Flask API with your scrapers (written in Requests+lxml) initiated with an API request.
I guess it’s a matter of preference