Re:Analyze terabytes of data with just a click of a button
by alooPotato on Friday August 17, 2012 @12:36PM
(#4397299)
At streak.com we use BigQuery to analyze our logs. All of our application logs are shipped over to BigQuery and we run sql commands over this large data set. Its been amazingly helpful.
We open sourced two things that helped us do this:
We open sourced two things that helped us do this:
1) A chrome extension to make bigquery's UI better, see here: http://blog.streak.com/2012/07/streak-developer-tools-chrome...
2) A library to push logs to bigquery if you're using appengine: http://blog.streak.com/2012/07/export-your-google-app-engine...