Re:AWS Outposts
by r00fus on Wednesday December 01, 2021 @04:29PM
(#29409358)
How do you even get the petabytes of data into S3 without incurring massive charges? Previous estimations of getting the initial dataset into cloud was.. prohibitive (note this was 3-4 years ago).
[ Parent
| on HN ]
Re:AWS Outposts
by laurencerowe on Thursday December 02, 2021 @02:52PM
(#29421525)
What charges in particular are you referring to? The cloud services only charge data egress fees. Data ingress is free.
The ENCODE Project data were a hundred terabytes or so at the point I migrated it into S3 (it's now over a petabyte.) We were on a fast academic network with a 100GB interconnect so could just `aws s3 sync` rather than worry about using AWS Snowballs or anything.