Re:Show HN: less than 650 LOC trainable GPT only using NumPy...
by joennlae on Friday November 17, 2023 @06:29PM
(#38312194)
That is true. I went for a simple implementation of the layer norm and included it in the tensorli definition. But it would have been better to define it as a moduli for clarity.
[ Parent
| on HN ]
There are no comments on this comment yet.