News for hackers. Stuff that matters.
Re:How the backpropagation algorithm works by plg on Monday April 14, 2014 @04:59PM (#7588903)
Nice description of backprop for sure.

Aren't people using conjugate gradient descent to optimize NN weights now? Sure you need the partial derivatives but ... that's what GPUs are for, right? :)

Re:How the backpropagation algorithm works by nimish on Monday April 14, 2014 @06:32PM (#7589303)
Backprop lets you calculate the gradient efficiently. What you do with that gradient is up to you (I would try L-BFGS or something akin to a stochastic variation). So you could use conjugate gradient or some other optimization method