News for hackers. Stuff that matters.
Re:Why HN is slow lately by gnaritas on Wednesday March 11, 2009 @02:52PM (#512238)
And it's running as a single process on a single server without a database storing everything on the file system. That it's doing the traffic it is I find quite impressive.
Re:Why HN is slow lately by pg on Wednesday March 11, 2009 @02:57PM (#512244)
In 2 GB of memory.
Re:Why HN is slow lately by gnaritas on Wednesday March 11, 2009 @03:04PM (#512258)
You know I'd love to see a writeup of the issues and challenges you've faced with this persistence strategy as the site grew. You know, more details of what you decided to lazy load, why, and how, and the impact it had.

Technically speaking, I find hacker news persistent strategy one of the most interesting things about the implementation.

I use a similar strategy for my blog and just playing with larger datasets I've certainly run into hard limits on what seems to be acceptable.

Re:Why HN is slow lately by brk on Wednesday March 11, 2009 @04:09PM (#512484)
Upstream. Both ways. In the snow.
Re:Why HN is slow lately by lsb on Wednesday March 11, 2009 @03:55PM (#512437)
Extrapolating from the memory-growth graph, how much time would a 16GB ram machine buy you?
Re:Why HN is slow lately by jwilliams on Wednesday March 11, 2009 @06:40PM (#512753)
I'd have thought that most of HN's traffic is on the front page, and it's associated comments. I could well be wrong - But given this I'd have thought 2GB was plenty, and wasn't the bottleneck.
Re:Why HN is slow lately by jwilliams on Thursday March 12, 2009 @01:20PM (#513736)
Re:Why HN is slow lately by emilis_info on Wednesday March 11, 2009 @03:47PM (#512408)
Are there any articles on the "HN storing everything on the file system"?

I am quite interested in the architecture, because I found this approach nice for some sites I was building. They were not very large though.

Re:Why HN is slow lately by jwilliams on Wednesday March 11, 2009 @06:38PM (#512751)
If you're keen, you can get the source code and take a look: http://www.arclanguage.com/install

File system stores aren't that uncommon (aside from the VSAM days, even in RDBMS times+) - it's a common approach for Wiki implementations too.

Re:Why HN is slow lately by aaronblohowiak on Wednesday March 11, 2009 @11:01PM (#512923)
Also, unless your DB tables are in-memory tables, you are using a very fancy interface to a file system store (that is usually in a nontrivial format.)
Re:Why HN is slow lately by critic on Wednesday March 11, 2009 @05:22PM (#512651)
> without a database

Why?

I can understand not using a database if this was improving the performance.