News for hackers. Stuff that matters.
Re:What Are Transformer Models and How Do They Work? by jaidhyani on Sunday April 16, 2023 @12:37PM (#35591571)
That's true, but they didn't go into any other applications in this explainer and were presenting it strictly as a next-word-predictor. If they are going to include final softmax, they should explain why it's useful. It would be improved by being simpler or more comprehensive, but complexity without reason is bad pedagogy.

There are no comments on this comment yet.