News for hackers. Stuff that matters.

A comment on Outrageously Large Neural Networks: The Sparsely-Gated Mixture-Of-Experts Layer. Parent comment

Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by michaelgrosner2 on Monday January 30, 2017 @07:35AM (#13520641)
Or set up an EC2 GPU unit - spot prices are usually in the sub $.20/hour range.
[ Parent | on HN ]
Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by reubenmorais on Monday January 30, 2017 @09:57AM (#13521635)
EC2 GPUs are slower to train than local hardware and more expensive long term. The upside is being able to scale much more easily, but I'd definitely recommend a good consumer grade GPU over EC2 if you're planning on using it for months as opposed to days.
[ Parent | on HN ]
Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by general_ai on Monday January 30, 2017 @11:49AM (#13522709)
They can also be unceremoniously preempted in the middle of your week long training run.
[ Parent | on HN ]