News for hackers. Stuff that matters.
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu... by lowbloodsugar on Tuesday January 05, 2016 @05:33PM (#10846602)
If such a limit exists, it would not have been hit on such a small benchmark. However, I am unaware of any such limit and it has never been raised in any discussion I have had with them. I am responsible for a large compute and data storage platform backed by S3.

Is this a limit that is hit anywhere near the 150GB discussed in this article, or is it something that you hit only if you are Netflix? We have TB in S3 and have not observed any limit other than EC2 instance bandwidth.

Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu... by jedberg on Tuesday January 05, 2016 @05:51PM (#10846728)
The amount of data one has in S3 isn't really relevant to the discussion, only how quickly you're trying to pull it into your instances.
Re:Feeding data to 1000 CPUs – comparison of S3, Google, Azu... by lowbloodsugar on Tuesday January 05, 2016 @06:14PM (#10846914)
Ok then let me rephrase: Is this a limit that is hit anywhere near the 603GB/s figure in this article, or is it something that you hit only if you are Netflix? You seem to be claiming that such a limit exists and that you know what it is. Can you share or is this NDA territory?