News for hackers. Stuff that matters.
Re:Show HN: Apifier – hosted web crawler for developers by benjmn on Tuesday October 20, 2015 @04:11PM (#10421502)
As a website owner, is it easy to block a rude crawler by contacting you ? (How would I identify in the first place that the crawler is operated by you ? Would my server logfile have enough data to point back to you ? )

Nice & useful demo. I'll give it a try.

Re:Show HN: Apifier – hosted web crawler for developers by jancurn on Tuesday October 20, 2015 @05:20PM (#10421889)
Currently, there is no way to distinguish traffic from our crawlers, but of course, let us know at [email protected] and we will blacklist your websites from our crawlers.