Does Hacker News sort trending topics on-the-fly or as a scheduled task?

Posted by mcassagnes on Friday July 03, 2015 @05:01PM
from the self-post dept.

I'm interested to know how they deal with massive amounts of data and still deliver blazing fast results. When I go to https://news.ycombinator.com/, are the threads sorted on-the-fly or pre-computed every x minutes? I found lots of information regarding the actual algorithm, but not how it is implemented.

( 6 comments | 10 points | on HN )

Re:Does Hacker News sort trending topics on-the-fly or as a ... by dang on Friday July 03, 2015 @06:41PM (#9828312)

It reranks items incrementally.

I'd love to get to the point where we can sort everything on every request.

[ Parent | on HN ]

Re:Does Hacker News sort trending topics on-the-fly or as a ... by mcassagnes on Friday July 03, 2015 @07:11PM (#9828402)

Do you have any source for this? I'd love to know more about how they re rank items incrementally.

Do they actually update every single row in the database every 5 minutes? It seems too slow.

[ Parent | on HN ]

Re:Does Hacker News sort trending topics on-the-fly or as a ... by snowwrestler on Friday July 03, 2015 @07:16PM (#9828420)

Source: dang is one of the employees of Y Combinator who help run HN.

Dang--might be good to have some way to indicate that so new folks understand your special role in the community here

[ Parent | on HN ]

Re:Does Hacker News sort trending topics on-the-fly or as a ... by dangrossman on Friday July 03, 2015 @07:31PM (#9828470)

HN doesn't use a database. There are no rows. Just one process on one server with everything in memory. Data is lazy loaded from flat files on-demand.

[ Parent | on HN ]

Re:Does Hacker News sort trending topics on-the-fly or as a ... by krapp on Friday July 03, 2015 @07:57PM (#9828547)

I assumed that in memory they had something structurally resembling a relational database but they might not. It would never even occur to me to not use a database for something like this.

[ Parent | on HN ]

Re:Does Hacker News sort trending topics on-the-fly or as a ... by mcassagnes on Friday July 03, 2015 @10:46PM (#9828932)

Thank you. I did not expect that!

[ Parent | on HN ]