alstream
Re:AppLovin: Processing 30B Requests A Day
on Friday March 13, 2015 @09:49PM (#9201222)
Thanks for your time!
About point 4, I'm assuming you built in idempotency into your message replay system. Is your unit of idempotency, say, 1 hour or some other unit of time, or is every single message have idempotent results? Because the latter would be pretty amazing :)
Re:AppLovin: Processing 30B Requests A Day
on Friday March 13, 2015 @09:47PM (#9201215)
Thank you for your input again! May I ask if you run Aerospike on an in-house cluster to reduce latency, or run on AWS?
Re:AppLovin: Processing 30B Requests A Day
on Tuesday March 10, 2015 @10:44PM (#9182245)
Some amazingly cool stuff that any engineer would want to be part of! Could anyone answer a few questions?
1. Is the Spark cluster running on top of an in-house cluster or on AWS EMR/S3?
2. Any more details about the custom message system, specifically how to guarantee exactly once delivery?
3. How do you guarantee data is never dropped?
4. "Make sure every message can be re-played without data corruption" how to achieve this when there is so many data points coming in?
Again, thank you for the insights!