Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on How to write a crawler. Parent comment
At some point querying the db to check what URLs you have can become quite heavy
There are no comments on this comment yet.
At some point querying the db to check what URLs you have can become quite heavy