News for hackers. Stuff that matters.
Re:How to Crawl the Web with Scrapy by amozoss on Monday September 13, 2021 @10:57PM (#28519674)
Their website was pretty trivial, but I beefed up the script to check for failure status code and also notify me if it wasn't 200.

I ran it every minute.

I had to include a unique uuid to cache bust, but other than that there wasn't any state.

I wrote about it here https://plainice.com/webscrape-notifications

There are no comments on this comment yet.