News for hackers. Stuff that matters.
Re:Ask HN: Is HN slow for you lately? Or even not responding? by pg on Thursday February 05, 2009 @03:20PM (#468611)
It's running out of memory. The half million or so of HN comments and stories no longer all fit in memory at once. This is not in itself a problem. We only load stuff as needed, and only crawlers ever look at the older stuff. But it does mean that eventually (currently after a day or so) we run out of space and the server crashes and restarts. I'm working on a less crude version of garbage collection.
Re:Ask HN: Is HN slow for you lately? Or even not responding? by jacquesm on Thursday February 05, 2009 @04:43PM (#468785)
It's a great scalability test then! Memory is cheap, so that should not be a really big issue then, 32G of ram in a server is nothing special these days. Unless of course you're already maxed out, then it is a different issue.

How big is the working set of HN ?

Re:Ask HN: Is HN slow for you lately? Or even not responding? by pg on Thursday February 05, 2009 @08:20PM (#469156)
We're maxed out on the current server.
Re:Ask HN: Is HN slow for you lately? Or even not responding? by jhawk28 on Thursday February 05, 2009 @03:58PM (#468718)
I guess you don't need to worry about all that complicated fragmentation with the current GC. :)