News for hackers. Stuff that matters.
Re:GitLab Serverless by 0x445442 on Wednesday December 12, 2018 @08:30AM (#18663671)
>> Our main path business path gets about 60,000 reqs min. For that, sure AWS Lambda would never compete.

I'm curious about this statement because I'm currently working on a project where the intent is to port a legacy app to AWS Lambda. The legacy app is currently distributed across 96 VMs and handles ~ 50K reqs/min during normal times but can run into ~ 3M reqs/min during high demand.

Are you saying AWS Lambda can not scale to handle this type of demand and if so can you point me to some resources/references that explain this?

For the record, I'm not the one that came up with the architecture.

Re:GitLab Serverless by jackpeterfletch on Wednesday December 12, 2018 @10:22AM (#18664612)
mcrittenden is right in that it probably will cost more to run than just having the old processes run on ECS/EC2. Lambda charges a premium for maintaining its control plane and development of the product that only makes sense to pay if your app has 'idle time'.

But also there is a per account per region concurrency limit of 1000 parallel executions. That's shared across all lambdas. If you hit it, requests will not be for-filed, increasing this limit is entirely at Amazons discretion, and wont they necessarily do it. I stand corrected, see comment.

https://docs.aws.amazon.com/lambda/latest/dg/limits.html

In your case 3m reqs/min will be fine if each request can be completed in no more than 20 milliseconds, and then you'll be on the knife edge.

If you wanted to reap the benefits of Lambda on the development side, loose the limits and keep server costs low(er) you could deploy OpenFaaS or similar in ECS. However you then loose the operational benefits of a managed solution.

Re:GitLab Serverless by mjb on Wednesday December 12, 2018 @11:57AM (#18665482)
The 1000 concurrency is a default limit, and we're very happy to raise it if you need more. The instructions for a limit increase request are here: https://docs.aws.amazon.com/lambda/latest/dg/concurrent-exec...

(Source: I work on Lambda at AWS)

Re:GitLab Serverless by jackpeterfletch on Wednesday December 12, 2018 @12:12PM (#18665642)
Fair play - added a correction, that statement came from discussions with our DevOps facility rather than first hand contact with Amazon, so there could be something else going on.
Re:GitLab Serverless by mcrittenden on Wednesday December 12, 2018 @08:54AM (#18663884)
I think he/she meant that Lambda wouldn't compete on pricing (as opposed to on performance).
Re:GitLab Serverless by geerlingguy on Wednesday December 12, 2018 @09:43PM (#18669486)
Both pricing and performance. It will scale, but it’s gonna cost a ton, and won’t be faster than running servers (and could be considerably slower for a percentage of requests).