News for hackers. Stuff that matters.
Re:A Neural Network in 11 Lines of Python by gambler on Monday March 28, 2016 @07:33PM (#11378356)
I am sick of reading about anything "deep" and "neural" on Hacker News (especially hype/puff pieces), but this blog post is so well-written that I'm upvoting it despite being about ANNs. I guess proper knowledge is the opposite of hype anyway.

I wish research papers on AI were a bit more like this and bit less like what they are.

Re:A Neural Network in 11 Lines of Python by iamtrask on Monday March 28, 2016 @07:38PM (#11378387)
Per your last comment, I'm thinking about changing this blog series to be a "blog" version of academic papers... starting with this one.

https://iamtrask.github.io/2016/02/25/deepminds-neural-stack...

Re:A Neural Network in 11 Lines of Python by partycoder on Monday March 28, 2016 @07:48PM (#11378441)
I love your blog, keep up the good work.
Re:A Neural Network in 11 Lines of Python by williamtrask on Monday March 28, 2016 @08:03PM (#11378518)
Thank you!
Re:A Neural Network in 11 Lines of Python by gambler on Monday March 28, 2016 @08:29PM (#11378660)
I think that's a great idea. At this point in time, there is so much stuff going on the CS/AI/ML domain that translating research papers into something people can read without incalculable suffering might be as important and valuable as research itself. After all, many of those papers concern things that almost anyone with access to a computer can actually implement and use.

PS: Bonus points for anything that diverges from the current mainstream (like SVMs or boosting).

Re:A Neural Network in 11 Lines of Python by zem on Monday March 28, 2016 @08:26PM (#11378638)
Re:A Neural Network in 11 Lines of Python by ktRolster on Monday March 28, 2016 @07:08PM (#11378201)
I thought it would be using a library, and I thought to myself, "of course, 11 lines is easy."

But all it uses is numpy. Pretty cool.

Re:A Neural Network in 11 Lines of Python by froh42 on Monday March 28, 2016 @07:28PM (#11378311)
Cool article, absolutely annoying CSS theme - as I tend to scroll back a little the title bar is jiggling in and out all the time. A number of sites uses this and this is SOOO distracting.
Re:A Neural Network in 11 Lines of Python by skypather on Monday March 28, 2016 @08:34PM (#11378690)
@froh42: What browser you were using? I read the article using Firefox on my PC (Windows 7) and I don't have any problems.
Re:A Neural Network in 11 Lines of Python by qmmm on Monday March 28, 2016 @07:44PM (#11378421)
derivative of sigmoid is wrong. should be sigmoid(x)*(1 - sigmoid(x))
Re:A Neural Network in 11 Lines of Python by zodiac on Monday March 28, 2016 @08:21PM (#11378617)
It seems like when he passes deriv=True in line 36 the first argument is the output of a previous nonlin, so it actually is the correct derivative.
Re:A Neural Network in 11 Lines of Python by williamtrask on Monday March 28, 2016 @08:28PM (#11378658)
Correct. I believe most implementations do it this way for efficiency... but my naming could be better.
Re:A Neural Network in 11 Lines of Python by roguas on Monday March 28, 2016 @07:37PM (#11378380)
bad python code (why `if var==True:` instead just `if var:`) also linting would go crazy, use spaces ;)

great example though!! ;)

Re:A Neural Network in 11 Lines of Python by zenlikethat on Monday March 28, 2016 @08:44PM (#11378730)
Looks like a nice article with lots of relevant content and code! Thanks for the in-depth piece iamtrask.
Re:A Neural Network in 11 Lines of Python by senthil_rajasek on Tuesday March 29, 2016 @04:11PM (#11384475)
perhaps the best thing I learned from this blog post is (in the author's own words), "I worked with neural networks for a couple years before performing this exercise..."

This contradicts the title. It may be 11 lines of python but not before 2 years of learning neural networks.

Re:A Neural Network in 11 Lines of Python by kbenson on Monday March 28, 2016 @07:29PM (#11378325)
12 lines. He forgot to import numpy. Pretty cool though.