News for hackers. Stuff that matters.

A comment on We Found an Neuron in GPT-2. Parent comment

Re:We Found an Neuron in GPT-2 by sharemywin on Friday February 17, 2023 @04:43PM (#34840992)
you might find this paper interesting:

https://arxiv.org/abs/2202.05262

Locating and Editing Factual Associations in GPT

[ Parent | on HN ]
Re:We Found an Neuron in GPT-2 by dpaleka on Friday February 17, 2023 @06:13PM (#34841885)
That paper (ROME) was the most famous paper in the field last year :)

See also new interesting developments breaking the connection between "Locating" and "Editing":

https://arxiv.org/abs/2301.04213

Does Localization Inform Editing? Surprising Differences in Causality-Based Localization vs. Knowledge Editing in Language Models

[ Parent | on HN ]