Re:Common Crawl announces Open Source Big Data code contest ...
by awavering on Tuesday September 18, 2012 @02:34PM
(#4539743)
Don't worry, we're working on it - we should have our results up by this weekend. We're planning on doing something like http://www.albertwavering.com/projects/commoncrawl/bill.html to show our results, but I would love to hear suggestions.
[ Parent
| on HN ]
Re:Common Crawl announces Open Source Big Data code contest ...
by 5c4r3d on Tuesday September 18, 2012 @06:09PM
(#4540794)
Oh cool. How many bills are you going to show? Will there be histograms or some kind of visualization or just the lists?
Re:Common Crawl announces Open Source Big Data code contest ...
by awavering on Wednesday September 19, 2012 @10:03AM
(#4543554)
We are looking at about 50 bills this time around. We really wanted to do a histogram, but we didn't have time to solve the problem of distinguishing between when things are crawled and when things are published.