News for hackers. Stuff that matters.
Re:Incomplete page loads on HN. What is going wrong? by pg on Saturday November 08, 2008 @11:05AM (#357601)
We're up against some MzScheme memory limit. Usually it's not a problem because we lazily load items from disk. Eventually, though, the news process runs out of memory and starts GCing excessively. We have other software that notices this and restarts it, but this time it missed the problem.
Re:Incomplete page loads on HN. What is going wrong? by frisco on Saturday November 08, 2008 @01:19PM (#357699)
Is HN flat-file based ala Viaweb, or is it on top of a relational database now?
Re:Incomplete page loads on HN. What is going wrong? by pg on Saturday November 08, 2008 @03:35PM (#357809)
Still files.
Re:Incomplete page loads on HN. What is going wrong? by utx00 on Monday November 10, 2008 @11:37AM (#359353)
still files as in "we're looking at something else"?
Re:Incomplete page loads on HN. What is going wrong? by jyothi on Monday November 10, 2008 @10:05AM (#359249)
yahoo days? :)
Re:Incomplete page loads on HN. What is going wrong? by CatDancer on Saturday November 08, 2008 @05:03PM (#357875)
Is running out of memory a bug in MzScheme, or instead e.g. Hacker News not removing references to items not recently used (that could be latest lazily loaded from disk if needed again)?
Re:Incomplete page loads on HN. What is going wrong? by pg on Saturday November 08, 2008 @07:21PM (#357936)
No.
Re:Incomplete page loads on HN. What is going wrong? by CatDancer on Saturday November 08, 2008 @08:28PM (#357964)
What I meant to ask was is this an issue with MzScheme or the Hacker News code? The reason why I'm asking is because I have a project I'm writing in Arc on MzScheme, and it would be helpful for me to know if MzScheme has a garbage collection bug that was biting you ;-/
Re:Incomplete page loads on HN. What is going wrong? by pg on Wednesday November 12, 2008 @11:23AM (#361938)
It's not a bug in MzScheme. The fundamental problem is that the server is a 32 bit machine with 4 GB of memory, only about 2.5 GB of which we can use. Really we should just upgrade to a 64 bit server.