News for hackers. Stuff that matters.
Re:Which GPU(s) to Get for Deep Learning by nightski on Monday May 22, 2017 @04:38PM (#14396744)
Not to mention, I can imagine it's frustrating uploading many gigs of data to amazon.
Re:Which GPU(s) to Get for Deep Learning by zeptomu on Monday May 22, 2017 @06:53PM (#14397518)
It is not that bad. Either you've your training data local (unlikely) or it is already available in the "cloud" (i.e. a public-facing service). Let's say a typical training set (raw data) is 100G.

Assuming 2.5MB/s Upload capacity with local data, you've uploaded it to your deep learning machine in half a day (100000 / 2.5 / 3600 ~ 11 hours) - which is not that much, as most of your time will be used for development and fine-tuning of your deep learning tool chain anyway. In most cases the data is accessible via a public-facing service, and assuming 1GBit/s bandwidth you've downloaded 100G in 13 minutes (100000 / 125 / 60 ~ 13 minutes).

Re:Which GPU(s) to Get for Deep Learning by chronic940 on Tuesday May 23, 2017 @01:06AM (#14398925)
You forgot the AWS Internet egress charge per GB..
Re:Which GPU(s) to Get for Deep Learning by zeptomu on Tuesday May 23, 2017 @05:30AM (#14399969)
What do you mean?

I know egress is one of the more expensive cloud services (e.g. compared to compute and storgage) at AWS, GCP, etc., but if I upload data to my learning system that's ingress AFAIK which is mostly free or less expensive. Btw. current Egress is like 0.1$/GB, so 100G ~ 10$.

Don't get me wrong, I am not saying you should always train in the cloud, but I do not think slower Upload or Ingress are the limiting factor.

Re:Which GPU(s) to Get for Deep Learning by treehau5 on Monday May 22, 2017 @04:54PM (#14396863)
extremely frustrating. Internet service is getting worse this in country, not better, sadly. The only lucky ones are those who live in competitive markets (lol) and those who had google fiber break some ground.

The anti-competitiveness is getting worse too. Charter just took over TWC in my area.