Re:Show HN: Dply – Free temporary Linux servers
by vidyesh on Thursday November 24, 2016 @11:06AM
(#13030966)
Wouldn't web scraping be considered abusive usage as it is frowned upon by most websites?
[ Parent
| on HN ]
Re:Show HN: Dply – Free temporary Linux servers
by ovibos on Thursday November 24, 2016 @11:15AM
(#13031038)
IMO scraping is only abusive if the site explicitly asks to not be scraped (via the site's robots.txt)
Re:Show HN: Dply – Free temporary Linux servers
by tedmiston on Thursday November 24, 2016 @11:28AM
(#13031117)
There are plenty of ways to scrape responsibly.
Re:Show HN: Dply – Free temporary Linux servers
by OwainX on Thursday November 24, 2016 @03:22PM
(#13032534)
Scraping, when done responsibly (respecting robots.txt and not overloading a server with requests) wouldn't be considered abusive in most cases. While we will be strict in enforcing abuse policies, when it's obvious a user acted with good intentions we can work on a case by case basis.