Twitter migrates data to Google Cloud

Re:Twitter migrates data to Google Cloud by pojzon on Wednesday January 23, 2019 @05:40AM (#18977185)

Migrations like these take time and happen step by step.

First you can try to replicate some data and move read instances. After that step by step the rest.

Its really not possible to do that overnight or months even.

Fyi: im currently migrating twice the Twitter size one in the world infrastructure from aws to azure now.

[ Parent | on HN ]

Re:Twitter migrates data to Google Cloud by tpetry on Wednesday January 23, 2019 @05:59AM (#18977253)

Isn‘t exporting 600TB of data from aws ridicously expensive?

[ Parent | on HN ]

Re:Twitter migrates data to Google Cloud by detaro on Wednesday January 23, 2019 @06:23AM (#18977350)

Twitters number is in PB, not TB. At that scale, assume that none of the normal pricing and procedures apply.

[ Parent | on HN ]

Re:Twitter migrates data to Google Cloud by asaddhamani on Wednesday January 23, 2019 @06:22AM (#18977345)

600TB would come out to around $50000 which for Twitter is peanuts. This is their bandwidth pricing though but I guess they'd use snowmobile export (if that exists?) instead.

[ Parent | on HN ]

Re:Twitter migrates data to Google Cloud by gervase on Wednesday January 23, 2019 @10:48AM (#18979174)

For reference, 300PB (the amount referenced in the article) using the same pricing would cost $25M. Still might be a reasonable one-time cost for migration for a large corporation, though, even disregarding the "bulk" rates they'd see at that scale.

[ Parent | on HN ]

Re:Twitter migrates data to Google Cloud by teej on Wednesday January 23, 2019 @08:42PM (#18985256)

AWS Snowmobile cost is $0.005/GB per month which comes out to $1.5M/month for 300PB for however long the data is on the truck.

[ Parent | on HN ]