News for hackers. Stuff that matters.
Re:Show HN: Six Degrees of Wikipedia by johnhenry on Tuesday February 27, 2018 @09:33AM (#16473592)
Great project! I wonder if you might be willing to go into more details about what made it an "interesting technical challenge"?
Re:Show HN: Six Degrees of Wikipedia by jwngr on Tuesday February 27, 2018 @10:50AM (#16474444)
The sheer scale of Wikipedia (5 millions pages, half a trillion links) made it difficult to make the searches fast. Simply downloading the Wikipedia database dumps and parsing them into my own database took over a day on my first successful attempt. The site returns most results in just a few seconds despite the giant graph size.