News for hackers. Stuff that matters.
Re:We Found an Neuron in GPT-2 by pera on Friday February 17, 2023 @08:15AM (#34834256)
I don't understand why your conclusion is that "the model must be thinking beyond the next token": the model doesn't need to do that to generate a well-formed sentence because it's not constrained by the size of the sentence.

There are no comments on this comment yet.