News for hackers. Stuff that matters.

A comment on How Akka Streams can be used to process the Wikidata dump in parallel. Parent comment

Re:How Akka Streams can be used to process the Wikidata dump... by thibaut_barrere on Tuesday June 23, 2015 @11:46AM (#9765419)
What are your favorite large, publicly available datasets?
[ Parent | on HN ]
Re:How Akka Streams can be used to process the Wikidata dump... by Smerity on Tuesday June 23, 2015 @05:19PM (#9767880)
Biased reply (I'm a data scientist there): Common Crawl[1]. We build and maintain an open repository of web crawl data that can be accessed and analyzed by anyone completely free.

[1]: http://commoncrawl.org/

[ Parent | on HN ]
Re:How Akka Streams can be used to process the Wikidata dump... by rcpt on Tuesday June 23, 2015 @11:19PM (#9769344)
This thread is pretty good

http://www.quora.com/Where-can-I-find-large-datasets-open-to...

[ Parent | on HN ]
Re:How Akka Streams can be used to process the Wikidata dump... by nextos on Tuesday June 23, 2015 @01:12PM (#9766033)
The Cancer Genome Atlas, Ensembl, 1000Genomes.
[ Parent | on HN ]