>You'd be surprised how difficult it is moving 22TiB of file storage to S3.
Really? I deal with this daily. Can you email [email protected] - if you're genuinely having or had issues moving 22TiB to S3 please LMK as that's abnormal for our customers and I want to fix it for you and others.
Thanks have passed your details on to our expert in this space.
For the public record this was mainly down to the problem of client reliability and migrating data live when there are 8,000 people hammering it with reads and writes. We went for a read/write through system and background synchronisation. The latter we had real reliability problems with and the upload performance wasn't great.
Also ROI didn't stack up in the end versus our SAN so we canned it.
Ok, if you guys pursue something like this again definitely check out something like storage gateway. It can help reduce the load in a live migration scenario like this.
The people that run their own infrastructure long ago realized that holding the key to mass consumption is the key to the control of the web. That's the thing they're all actually competing on. Good luck competing with them on it when they're controlling your rates. Cheap in, expensive out.
The future is bare metal IaaS with something non-provider specific that sits on that as that is 100% portable between Cloud/in house. Docker/openstack that sort of thing.