News for hackers. Stuff that matters.
Re:We ditched Google Analytics by X-Istence on Tuesday December 08, 2015 @05:43PM (#10700278)
The appliance is so that you don't need to send terabytes of data over a 10 Gbit/sec connection for example to their datacenter.

The limitation is actually the pipe that connects you to Amazon, not an inherent limitation within S3 or other services within Amazon on connection speed. If you have a good enough connection, or peering with Amazon things go amazingly fast.

When I worked at an ISP, we slammed about 20 Gbit/sec into S3 without issues, but even then data we were backing up -- about 300 TB of data a day -- at that rate took 1.4 days to upload to the cloud, so we ended up backing it up in-house instead. (we needed to store the data for 7 days, after that it went bye bye).

Re:We ditched Google Analytics by toomuchtodo on Tuesday December 08, 2015 @05:54PM (#10700375)
> When I worked at an ISP, we slammed about 20 Gbit/sec into S3 without issues, but even then data we were backing up -- about 300 TB of data a day -- at that rate took 1.4 days to upload to the cloud, so we ended up backing it up in-house instead. (we needed to store the data for 7 days, after that it went bye bye).

Seems like the perfect usecase for S3; inbound transfer is free, and you're only paying for a rolling 7 day window of storage with lifecycle rules :/

Re:We ditched Google Analytics by niutech on Saturday December 12, 2015 @01:25PM (#10723590)
Can I ask, why would an ISP upload 300TB data/day? Are you wiretapping all users' packets?