We reduced the AWS costs of our streaming data pipeline

Re:We reduced the AWS costs of our streaming data pipeline by sidlls on Thursday May 28, 2020 @01:24AM (#23333673)

That depends on the scale and other particulars that are only shared/known inside the company.

In my experience, beyond a certain scale it simply doesn't make any sense to use managed services anymore. There is a high initial upfront cost in development hours and hardware that is amortized over a very long time after, and this upfront cost is partially paid for by the reduced cloud bill.

[ Parent | on HN ]

Re:We reduced the AWS costs of our streaming data pipeline by glogla on Thursday May 28, 2020 @05:59PM (#23343296)

That also depends on the markup.

EKS on EC2 costs EC2 costs + flat money for control plane, so that might make more sense than running your own Kubernetes on EC2. (although I have no experience to say how much time this actually saves you)

Managed Kafka costing 2x the cost of EC2 infrastructure? Probably not worth it.

[ Parent | on HN ]