iamtrask
Re:A Survival Guide to a PhD
on Wednesday September 07, 2016 @11:01PM (#12449969)
many people seem to discount this thread because "Karpathy is one of the most successful PhD students in his field"
perhaps instead of discounting his experience... it would be better to take his advice
Re:A Neural Network in 11 Lines of Python
on Monday March 28, 2016 @07:38PM (#11378387)
Per your last comment, I'm thinking about changing this blog series to be a "blog" version of academic papers... starting with this one.
https://iamtrask.github.io/2016/02/25/deepminds-neural-stack...
Re:Show HN: Sense2vec model trained on all 2015 Reddit comments
on Monday February 15, 2016 @07:05PM (#11106999)
....now we know
Re:Teaching Machines to Read and Comprehend – Deepmind [pdf]
on Thursday June 11, 2015 @11:35AM (#9700312)
This paper is extraordinary! How has it been 9 hours with only one point?
Re:SEC approves 200+ million Americans as Angel Investors
on Friday March 27, 2015 @05:29PM (#9279132)
pure democracy via capitalism... interesting. Are the masses smarter than the 1% is generous?
Re:Distributing a Fully Connected Neural Network Across a Cluster
on Monday November 24, 2014 @11:50PM (#8656393)
Precisely! I highly encourage checking out the slide-deck for a graphical representation.
For every node in every other layer, I colocate the edge on the same machine. In this way, when a group of, say, 10 nodes in layer 1 are each sending a weighted message to a single node in layer 2... they can pre-combine their messages (weighted sum) and send only that value over the network. This happens for every node in the second layer, reducing network i/o (this is the first optimization).
Re:Distributing a Fully Connected Neural Network Across a Cluster
on Monday November 24, 2014 @11:18PM (#8656322)
This also might help... here are some slides graphically showing how the distribution works. http://prezi.com/hdctecihctdr/?utm_campaign=share&utm_medium...
Re:Distributing a Fully Connected Neural Network Across a Cluster
on Monday November 24, 2014 @11:12PM (#8656305)
i apologize for the verbosity and thickness. Happy to answer questions though. :)
Word2vec Algorithm on Harry Potter
Tutorial: when Numpy isn't fast enough...
Re:Tutorial: Apache Spark on GPU(s)
on Saturday November 22, 2014 @09:32PM (#8647601)
benchmarks like that coming soon :)