News for hackers. Stuff that matters.
Re:Escape the scripter mentality if reliability matters (2011) by XCSme on Saturday July 27, 2019 @11:46AM (#20542528)
The final point in my comment was that even if you spend a lot of time trying to make a more reliable product instead of a quick script, you still can't be sure it will never break in the future as the data source can become invalid at any point. Imagine a news website, they update their platform and suddenly all 404 pages actually redirect to first article/post in database instead of correctly returning 404, so your product would crawl the same data each day and say everything is fine, even though it's not. There are infinite such problems that can arise, so even if you have a well-thought product, it still needs some human sanity-checks and updates once in a while.

There are no comments on this comment yet.