News for hackers. Stuff that matters.

A comment on Outrageously Large Neural Networks: The Sparsely-Gated Mixture-Of-Experts Layer. Parent comment

Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by akhilcacharya on Monday January 30, 2017 @08:41AM (#13521023)
If we're not researchers, when is it still even neccessary to develop new architectures? Seems like these days most DL applications in Computer Vision just use pretrained models with transfer learning.
[ Parent | on HN ]
Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by anigbrowl on Monday January 30, 2017 @03:38PM (#13524784)
If you're not a researcher, why are you doing it? If you have any other motivation besides discovery, expect that to get automated away in short order and whatever you do to rapidly become obsolete. Curiosity is your best asset.
[ Parent | on HN ]
Re:Outrageously Large Neural Networks: The Sparsely-Gated Mi... by akhilcacharya on Monday January 30, 2017 @08:16PM (#13526644)
Many image problems can still be solved by machine learning solutions - if I don't need to spend time re-inventing the wheel, why do so?
[ Parent | on HN ]