News for hackers. Stuff that matters.

A comment on Does my data fit in RAM?. Parent comment

Re:Does my data fit in RAM? by dijit on Wednesday February 12, 2020 @04:13PM (#22312876)
How long does it take to copy your data in? And what’s the bandwidth cost involved?

People like to talk about the elasticity or compute, but startup is not free (or even cheap in most cases).

[ Parent | on HN ]
Re:Does my data fit in RAM? by cldellow on Wednesday February 12, 2020 @05:26PM (#22313487)
If your data is in S3, my experience is that you can push ~20-40MB/core/sec on most instances.

OP is probably talking about an x1e.32xlarge. According to Daniel Vassalo's S3 benchmark [1], it can do about 2.7GB/sec.

So your 4TB DB might take ~30min to fetch.

Bandwidth is free, you'd pay $2 for the 30 min of compute, and some fractions of pennies for the few hundred S3 requests.

[1]: https://github.com/dvassallo/s3-benchmark

[ Parent | on HN ]
Re:Does my data fit in RAM? by satanspastaroll on Thursday February 13, 2020 @05:16AM (#22316604)
It's to note that any data exported out of AWS will be billed at $0.09/GB, or $90/TB
[ Parent | on HN ]