Re:Common Crawl announces Open Source Big Data code contest ...
by bollacker on Tuesday September 18, 2012 @05:42PM
(#4540679)
I like how this contest shows that anyone can ask questions that previously only Google, Microsoft (Bing) and a handful of 2nd tier search engines could ask. Now if we can just get a simple query language for it all. I could then pump in $100 in quarters, ask my question, and wait a couple hours. Isn't this what the information ask was supposed to get us?
Re:Common Crawl announces Open Source Big Data code contest ...
by 5c4r3d on Tuesday September 18, 2012 @02:28PM
(#4539698)
Linking Entities to Wikipedia is awesome. I love the idea of Online Sentiment Towards Congressional Bills but it's too bad they didn't show their results.
Re:Common Crawl announces Open Source Big Data code contest ...
by awavering on Tuesday September 18, 2012 @02:34PM
(#4539743)
Don't worry, we're working on it - we should have our results up by this weekend. We're planning on doing something like http://www.albertwavering.com/projects/commoncrawl/bill.html to show our results, but I would love to hear suggestions.
Re:Common Crawl announces Open Source Big Data code contest ...
by awavering on Wednesday September 19, 2012 @10:03AM
(#4543554)
We are looking at about 50 bills this time around. We really wanted to do a histogram, but we didn't have time to solve the problem of distinguishing between when things are crawled and when things are published.