Re:Transformer learning explained: Coinductive guide to indu...
by ftxbro on Tuesday February 28, 2023 @09:57PM
(#34978214)
Is it possible to explain what you are doing like I'm a normie who doesn't know and isn't willing to learn algebraic geometry, category theory, or control theory? In other words, explain only in terms of plain finite dimensional linear algebra like eigenvalues, left- and right-eigenvectors, row- and column-stochastic matrices, conjugate transpose, trace, matrix inverse, matrix exponential, etc.?
[ Parent
| on HN ]
Re:Transformer learning explained: Coinductive guide to indu...
by adamnemecek on Tuesday February 28, 2023 @10:47PM
(#34978536)
Hopf algebras are analogous to electrical circuits with feedback and incrementally "learn" eigenvalues by processing incoming data without needing additional processing.