Re:A Neural Network in 11 Lines of Python
by qmmm on Monday March 28, 2016 @07:44PM
(#11378421)
derivative of sigmoid is wrong. should be sigmoid(x)*(1 - sigmoid(x))
[ Parent
| on HN ]
It seems like when he passes deriv=True in line 36 the first argument is the output of a previous nonlin, so it actually is the correct derivative.
Re:A Neural Network in 11 Lines of Python
by williamtrask on Monday March 28, 2016 @08:28PM
(#11378658)
Correct. I believe most implementations do it this way for efficiency... but my naming could be better.