News for hackers. Stuff that matters.

A comment on S3 Strong Consistency. Parent comment

Re:S3 Strong Consistency by yftsui on Tuesday December 01, 2020 @10:04PM (#25272814)
I am curious about how much Dropbox pays for data ingress/egress, they migrated storage to their own on premise data center, then now moving data back to S3 for the data lake.
[ Parent | on HN ]
Re:S3 Strong Consistency by Scaevolus on Tuesday December 01, 2020 @10:57PM (#25273093)
That's analytics data, not file storage. If they have 34PB of analytics, they certainly have far more than that of blob storage.
[ Parent | on HN ]
Re:S3 Strong Consistency by ashish-gandhi on Wednesday December 02, 2020 @05:46AM (#25275228)
Definitely much more of user data storage. More about that https://dropbox.tech/infrastructure/inside-the-magic-pocket.

Happy to take other questions.

[ Parent | on HN ]
Re:S3 Strong Consistency by qt_scientist on Wednesday December 02, 2020 @07:34AM (#25275779)
Did you consider building a S3 API in front of Magic Pocket so it could also serve as your analytics storage?

Or is your compute so bursty that it's more beneficial to be in the cloud on EC2 than to host on prem compute in front of Magic Pocket?

[ Parent | on HN ]
Re:S3 Strong Consistency by SteveNuts on Tuesday December 01, 2020 @11:58PM (#25273413)
I thought they were almost entirely on prem for the actual storage
[ Parent | on HN ]
Re:S3 Strong Consistency by ddorian43 on Wednesday December 02, 2020 @05:00AM (#25274993)
See https://github.com/rockset/rocksdb-cloud
[ Parent | on HN ]
Re:S3 Strong Consistency by bboreham on Wednesday December 02, 2020 @01:46AM (#25273852)
Amazon has hard-disk products for large transfers. Snowcone, Snowball and Snowmobile.
[ Parent | on HN ]