darkrho

Try it out via conda!

  conda install -c scrapinghub/label/dev scrapy

There is ScrapyRT: http://blog.scrapinghub.com/2015/01/22/introducing-scrapyrt-...

In the project I work on we do have the usual periodic crawls and use ScrapyRT to let the frontend trigger realtime scrapes of specific items, all of this using the same spider code.

Edit: Worth nothing that we trigger the realtime scrapes via AMQP.

Thanks for such extended reply!

Years ago I've been asked: There is a file named "-foo", how do you delete it?

Do you have any example problem to share? I've taken a numerical analysis class and this interview-like questions are appealing.

Re: E(x,z) is false (or !E(x,z)). Otherwise we would have E(y,z) given that E(y,x), that's a contradiction.

Here is a similar project: https://github.com/scrapinghub/splash#renderpng

I agreed. Harry can't talk about a Monoid with that non well-defined function. He deserved to be fired :D

(As I pointed out in my comment: http://www.jasq.org/2/post/2013/01/the-mathematician-the-mon...)

same here