Re:A shared file system for lambda functions
by hansef on Tuesday June 16, 2020 @07:37PM
(#23545705)
This - if you have to fetch data from or output data to outside of the AWS ecosystem, the 512mb /tmp limit pushes you into the additional (relative) complexity of having to run on Fargate pretty quickly. Just had to deal with this for a content ingest job involving pulling a couple GB of data from an FTP server, processing it and pushing it into an RDS database on an hourly basis. Would have been super simple if the file was on S3 already.
[ Parent
| on HN ]
Re:A shared file system for lambda functions
by jupp0r on Wednesday June 17, 2020 @08:15PM
(#23558387)
Where do you need a distributed file system in this use case? Sounds like all you need is some local scratch space?
Re:A shared file system for lambda functions
by scarface74 on Thursday June 18, 2020 @06:48AM
(#23561832)
Lambda only gives you 512MB pf local “scratch space”. If it had to provision and de provision gigs of space at each invocation, it would probably cause longer start times and shut down times.