News for hackers. Stuff that matters.
Re:Outgrowing Apache Storm: why we built in-house distribute... by henridf on Thursday October 01, 2015 @07:03PM (#10315432)
Makes sense. How do you deal with data arriving out-of-order? (assuming your data is timestamped at the source)
Re:Outgrowing Apache Storm: why we built in-house distribute... by mike_heffner on Thursday October 01, 2015 @07:38PM (#10315582)
We grab a timestamp when data hits our API (largely as close to source as we can get) and use that to order time samples. For time series the ordering requirements aren't as strict as other problem domains, since we can usually go back and overwrite previous time series data points.