Re:The Secrets of Building Realtime Big Data Systems
by devinfoley on Saturday March 26, 2011 @02:52AM
(#2371533)
I love that the slide after "[Data systems must be] 1. Robust to machine failure" is an error "Oops! This slide did not convert properly hence cannot be displayed." Oh the irony.
Re:The Secrets of Building Realtime Big Data Systems
by omakase on Saturday March 26, 2011 @01:30AM
(#2371436)
We use Python for all our data collecting, general scripting, and some of our stream processing (though stream processing is moving to a more generalized framework that is Java/Clojure based).
Also, our underlying API (that serves results to all our products/API/etc) is a collection of Python servers written with Twisted and Thrift.
Re:The Secrets of Building Realtime Big Data Systems
by n_are_q on Saturday March 26, 2011 @05:36AM
(#2371732)
Clever. Does the system also support non-aggregate queries? Such as if you wanted to display to a user individual pieces of data for their site for example.
BackType looks cool btw, got an API key a while back and started playing with it.
Also, our underlying API (that serves results to all our products/API/etc) is a collection of Python servers written with Twisted and Thrift.