News for hackers. Stuff that matters.

A comment on Abusing AWS Lambda to make an Aussie search engine. Parent comment

Re:Abusing AWS Lambda to make an Aussie search engine by Dunedan on Monday September 27, 2021 @01:18PM (#28673445)
What is the maximum memory size you tested the AWS Lambda functions with? From your article it seems you did try with 1024MB. Did you try with more memory as well? In case you don't know, you need at least 1769MB of memory to get a full vCPU [1].

When running locally on your physical machine, is your code only utilizing a single CPU core or does it make use of multiple cores? If it's the latter one, increasing the memory for the AWS Lambda function even further should improve performance as well.

Also if you hit a performance plateau with a memory size of less than 1769MB for your AWS Lambda functions, you could be bottlenecked by something else. I can imagine details like memory bandwidth playing a role there as well.

[1]: https://docs.aws.amazon.com/lambda/latest/dg/configuration-f...

[ Parent | on HN ]
Re:Abusing AWS Lambda to make an Aussie search engine by boyter on Monday September 27, 2021 @02:51PM (#28674510)
I tried up to the maximum a few times. The code is single threaded. It is indeed also memory bandwidth bottlenecked. Which I think might be the main issue with it in lambda.

My guess based on my tests is that memory access and cpu are the limiting factors in lambda for this but that because it encourages scale out less of an issue.

[ Parent | on HN ]