Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on Ask HN: Google web corpus + big data analysis cluster?.
1) How frequently would you crawl?
2) What are you defining as a 'massive scale'? It'll probably grow i'm sure but what is a reasonable range you're working with?
3) Which languages will you be supporting?
There are no comments on this comment yet.
1) How frequently would you crawl?
2) What are you defining as a 'massive scale'? It'll probably grow i'm sure but what is a reasonable range you're working with?
3) Which languages will you be supporting?