News for hackers. Stuff that matters.
Re:Your Transformer is Secretly Linear by jcparkyn on Friday May 24, 2024 @09:32AM (#40466099)
A fun example of that (making a neural network using floating point error as a source of non-linearity): https://youtu.be/Ae9EKCyI1xU?si=n9vgvCvxoxrQeKd8

There are no comments on this comment yet.