News for hackers. Stuff that matters.
Re:We Found an Neuron in GPT-2 by laszlokorte on Thursday February 16, 2023 @05:47PM (#34827683)
From my naïve point of view it seems obvious that at any point where both an „a“ or a „an“ would fit the model randomly selects one of them and by doing so reduces the set of possible nouns to follow.
Re:We Found an Neuron in GPT-2 by Sharlin on Thursday February 16, 2023 @06:16PM (#34828100)
No, of course not randomly. If you RTA, it should be clear that some prompts are more likely to be followed by an “an” than others.