s3 is awesome. Keep using it but put your own boxes in a colo with a direct connect to aws (not all colos offer this unfortunately). Your boxes can then g3 20+tb of ssd cache in front of your raw pb+ datasets in s3.

https://aws.amazon.com/directconnect/pricing/