Re:TopoNets: High performing vision and language models with...
by cwillu on Thursday January 30, 2025 @11:35PM
(#42884724)
Was it toxicity though as understood by the model, or just a cluster of concepts that you've chosen to label as toxic?
I.e., is this something that could (and therefore, will) be turned towards identifying toxic concepts as understood by the chinese or us government, or to identify (say) pro-union concepts so they can be down-weighted in a released model, etc?
Re:TopoNets: High performing vision and language models with...
by mayukhdeb on Thursday January 30, 2025 @11:43PM
(#42884760)
We localized "toxic" neurons by contrasting the activations of each neuron for toxic v/s normal texts. It's a method inspired by old-school neuroscience.
I.e., is this something that could (and therefore, will) be turned towards identifying toxic concepts as understood by the chinese or us government, or to identify (say) pro-union concepts so they can be down-weighted in a released model, etc?