News for hackers. Stuff that matters.
Re:AppLovin: Processing 30B Requests A Day by themartorana on Monday March 09, 2015 @08:54PM (#9175236)
And I was proud of my API backend processing 70M requests a day... That's suddenly feeling like a lot less traffic and a lot less spectacular.
Re:AppLovin: Processing 30B Requests A Day by elcct on Tuesday March 10, 2015 @01:13PM (#9178953)
I was able to process about 250M requests a day on a dedicated server (E3) without breaking a sweat.
Re:AppLovin: Processing 30B Requests A Day by ddorian43 on Tuesday March 10, 2015 @04:26PM (#9180386)
It depends on what you're doing in those requests.

Ex: Realtime stats system. On each request doing several get,set,increment,push-into-queue, geoip + 1 bulk-postgresql-upsert every second. 1ms response, 400 requests/second, 3 python processes, 10$/month shared hosting.

Re:AppLovin: Processing 30B Requests A Day by eugeneionesco on Monday March 09, 2015 @09:11PM (#9175327)
On what hardware was that?
Re:AppLovin: Processing 30B Requests A Day by themartorana on Monday March 09, 2015 @09:31PM (#9175424)
AWS, ~11 EC2 c1-medium boxes (auto scales), one db.r3.4xlarge RDS MySQL server, plus a beefy Redis server (instance size escapes me).

FreeBSD 10 on the EC2 boxes, whatever Linux AWS is running on their managed service instances. Nginx backed by Python and Go servers.

Plus a smattering of other services like ELBs, etc.

I can't imagine having something so critical that you build a custom Nginx plugin. I thought I was cool for doing a bit of Lua scripting. :)

Re:AppLovin: Processing 30B Requests A Day by avidas on Tuesday March 10, 2015 @04:18AM (#9176589)
How were your monthly expenses like for this setup?
Re:AppLovin: Processing 30B Requests A Day by themartorana on Tuesday March 10, 2015 @07:22AM (#9177106)
Although it's difficult to fully articulate, as our traffic is basically a bell curve through the day and we auto scale between say 7 and 13 servers throughout the day... We pay about $4200/month. That includes several TB of traffic (which we gzip compress where it makes sense).