News for hackers. Stuff that matters.
Re:Learning Machine Learning: A beginner's journey by Dzugaru on Monday December 26, 2016 @03:12AM (#13257457)
Pretty much this. In the real world you have to deal with

- Too few labeled / garbage labeled data (70000 digits? How about only 1000 complex class objects?)

- Obscure bugs in custom implementation (yeah my custom layer works and gradient is correct... or wait why it diverges after 10k iteration? hmm).

- Timing/RAM constraints (it should segment an image under 10ms on Jetson TX1, well, good luck with GoogLeNet)

Re:Learning Machine Learning: A beginner's journey by epberry on Monday December 26, 2016 @05:02AM (#13257706)
Nailed it. Neural net execution speed is so critical for may production systems and it's very difficult to hit the sweet spot on trade offs but I never hear about these issues in wild.
Re:Learning Machine Learning: A beginner's journey by Eridrus on Monday December 26, 2016 @08:39AM (#13258172)
> Nailed it. Neural net execution speed is so critical for may production systems and it's very difficult to hit the sweet spot on trade offs but I never hear about these issues in wild.

That's probably because you're not listening. There's plenty of literature on scaling down neural nets to smaller devices because everyone knows it's an issue and can trivially get a smaller device, see techniques such as Quantization , Distillation, Pruning or architectures specifically designed for the task such as YOLO.