News for hackers. Stuff that matters.
Re:Prime Video service dumps microservices, cuts AWS bill 90% by zamnos on Sunday May 07, 2023 @03:36AM (#35848864)
Just serve and not transcode? Because it sounds like the Amazon Prime microservice was doing some heavy processing of uploaded video - breaking it into frames and applying some ML algorithms to them, and also the same with the audio. Sounds like even if you can fit in under the 10 min lamda execution timeout (assuming internal teams are limited to the same), that it's not great as a generic job queue handler.
Re:Prime Video service dumps microservices, cuts AWS bill 90% by emodendroket on Sunday May 07, 2023 @03:42AM (#35848904)
Writing every frame to S3 and reading them back in other steps was probably a major factor.
Re:Prime Video service dumps microservices, cuts AWS bill 90% by traspler on Sunday May 07, 2023 @06:51AM (#35850099)
There is not much of an option with step functions, outputs/inputs can be max 256KB so especially if you go into or out of a map/parallel state you can‘t do much more than pass references to the data and not the data itself.
Re:Prime Video service dumps microservices, cuts AWS bill 90% by emodendroket on Sunday May 07, 2023 @01:02PM (#35853390)
Sure but I guess I mean the nature of that task probably made them the wrong architectural choice.