News for hackers. Stuff that matters.
Re:The Neural Network Zoo (2016) by sabalaba on Friday December 06, 2019 @12:29AM (#21719505)
I have always absolutely hated this diagram and think it should go away. I have also never seen somebody who understands the content of the diagram share it as a useful pedagogical tool.

For example, with CNNs, you are building up feature activation volumes based on the entire previous layer. The edges between layer N only connects to two nodes in layer N-1. What are the nodes even supposed to represent? This is not how CNNs works. This explains nothing and is actually just confusing.

This entire diagram should be re written using the block diagrams from the actual papers.

Re:The Neural Network Zoo (2016) by gdubs on Friday December 06, 2019 @12:03PM (#21723692)
Shameless self-promotion: I was learning about Neural Networks and found the diagrams lacking, so I made a project of visualizing one. Posted a teaser-clip of the project to instagram here:

https://www.instagram.com/p/B4EchudFiTe/?igshid=cuf9ozx0cpc7

Description in the caption, but the gist is that I created a 3D representation of the canonical handwriting recognizer, using Swift and Apple’s Metal framework for rendering.

Re:The Neural Network Zoo (2016) by stared on Friday December 06, 2019 @06:33AM (#21720882)
I agree that these diagrams are very abstract, verging on minimalistic data art. To a large extent, if you know what is going on, you don't need this diagram. If you don't - a diagram does not help.

Vide "Simple diagrams of convoluted neural networks" (https://medium.com/inbrowserai/simple-diagrams-of-convoluted...) in which I discuss various neural network architeture visualizations.

Re:The Neural Network Zoo (2016) by Raphaellll on Friday December 06, 2019 @04:30AM (#21720298)
My experience is that this is only shared by people on LinkedIn who have no clue what they are talking about.
Re:The Neural Network Zoo (2016) by euroPoor on Friday December 06, 2019 @06:38AM (#21720915)
To add an anecdote: I’ve only seen it in professor’s labs before and have been looking for it for a long time.
Re:The Neural Network Zoo (2016) by BiasRegularizer on Friday December 06, 2019 @03:09AM (#21720016)
Also in the VAE diagram, the latent space appears to have the same dimensions as input and output.
Re:The Neural Network Zoo (2016) by acro on Friday December 06, 2019 @05:35AM (#21720599)
To me the DCN picture looks ok, in convolution layer nodes receive input only from small area of the previous layer, in general this is true for convolution layers (kernels) and pooling layers. After that it has couple of fully connected layers where the connections go from every node to every node. Or have I misunderstood something in your comment?
Re:The Neural Network Zoo (2016) by mysterydip on Friday December 06, 2019 @06:01AM (#21720712)
Do you know of a resource that has done the block diagram format? I want to understand more about NNs but all I see are node diagrams.
Re:The Neural Network Zoo (2016) by sabalaba on Friday December 06, 2019 @01:32PM (#21724664)
Yes, go to scholar.google.com and search the name of the network. You’ll find the original paper (it will likely have many citations) which will describe the architecture in detail and have a useful diagram for you.