Re:Show HN: Six Degrees of Wikipedia
by johnhenry on Tuesday February 27, 2018 @09:33AM
(#16473592)
Great project! I wonder if you might be willing to go into more details about what made it an "interesting technical challenge"?
[ Parent
| on HN ]
The sheer scale of Wikipedia (5 millions pages, half a trillion links) made it difficult to make the searches fast. Simply downloading the Wikipedia database dumps and parsing them into my own database took over a day on my first successful attempt. The site returns most results in just a few seconds despite the giant graph size.