News for hackers. Stuff that matters.

muppet_frog

Re:Why deep learning works even though it shouldn’t on Tuesday October 20, 2020 @05:29PM (#24842534)
This paper makes the points that it's the saddles and not local minima that are the problem: https://arxiv.org/abs/1406.2572 It was the basis for adding 'momentum' to optimizers - so that you could skate across the saddles.
Re:Why deep learning works even though it shouldn’t on Tuesday October 20, 2020 @05:26PM (#24842493)
...hmm, that was counter to my understanding (limited though it may be...) which was partially formed by this paper: https://arxiv.org/abs/1712.09913

TLDR - loss landscapes are nasty, but you can tame them with skip connections.

...sounds like it costs much more than the $10 pi0...

I imagine the OP's use case of IoT did not require huge amounts of bandwidth.

Re:The Samson Switchblade flying car on Thursday March 12, 2020 @04:10PM (#22561212)
Ahem...trebuchets are superior to catapults in every way.
Not sure I would call a New York Times article 'clickbait'...