$ time jq .type *.json | wc -l
408218
real 0m16.788s
user 0m16.366s
sys 0m0.325s
That's an easy amount of data to mess with. If a day is 16 seconds to process, I can do 14 years on my measly desktop in one day! 408k public records - around 5 a second. I somehow imagined events would flood into github even faster than that. I wonder what their public/private activity ratio is.
Re:Third Annual GitHub Data Challenge
by onetimeusename on Tuesday July 22, 2014 @09:06PM
(#8072411)
I don't get why the first prize is a one-day course about data visualization. You already won the contest which shows that you are knowledgeable about data visualization, what would a 1 day course do for you?
Re:Third Annual GitHub Data Challenge
by aleksi on Wednesday July 23, 2014 @02:58AM
(#8073201)
> you’re not participating from a country against which the United States has issued export sanctions or other trade restrictions, including Cuba, Iran, North Korea, the Sudan and Syria
Re:Third Annual GitHub Data Challenge
by sytelus on Tuesday July 22, 2014 @09:02PM
(#8072401)
Why prizes for this competition is so pathetic. Looks like a corporate moral budget where you skimp for pennies (I know for a fact of a big company having $75 moral budget per person per year). Is this how much our time worth? At least the organizers could have been more creative if execs at Github decided to through mere pennies at developers to compete like giving out some cool designed t-shirts or something.
Re:Third Annual GitHub Data Challenge
by oniTony on Wednesday July 23, 2014 @12:43AM
(#8072941)
> Top 3 winners get $200, $100, and $50
Those are 2013 numbers. This year it's "all-expense paid trip to attend a one-day data visualization course", $500, and $250 for top 3 winners. But presumably this isn't meant to be done as a job.
Let's explore the event types:
Pushes dominate - 10 pushes for every issue created.This is probably more than enough for an HN comment. It'll be fun to see what people do with this stuff this year. :)
I wasn't aware until today that you could use BigQuery on a recently-updated data set, though.
Does it include Russia this days?
Top 3 winners get $200, $100, and $50
Those are 2013 numbers. This year it's "all-expense paid trip to attend a one-day data visualization course", $500, and $250 for top 3 winners. But presumably this isn't meant to be done as a job.