Re:Ask HN: Is AI essentially just linear algebra?
by AnimalMuppet on Friday April 20, 2018 @12:36PM
(#16886255)
If I understand correctly (and I am very much not an expert), deep neural nets can't be purely linear. The "adding inputs to produce an output" part has to have a nonlinearity in it, or the nets don't work well.
Source: Attended a couple of hours of lecture on neural nets for speech recognition. (Yeah, that gives you a pretty accurate picture of the depth of my knowledge here. But if the lecturer was right, the neural net part of AI can't be linear algebra. It's linear-ish, but not linear.)
Source: Attended a couple of hours of lecture on neural nets for speech recognition. (Yeah, that gives you a pretty accurate picture of the depth of my knowledge here. But if the lecturer was right, the neural net part of AI can't be linear algebra. It's linear-ish, but not linear.)