Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders
by benchmarkist on Thursday November 21, 2024 @08:23PM
(#42210349)
Interpretability research is basically a projection of the original function implemented by the neural network onto a sub-space of "explanatory" functions that people consider to be more understandable. You're right that the words they use to sell the research is completely nonsensical because the abstract process has nothing to do with anything causal.
[ Parent
| on HN ]
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders
by HeatrayEnjoyer on Thursday November 21, 2024 @10:00PM
(#42210754)
All code is causal.
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders
by benchmarkist on Thursday November 21, 2024 @10:05PM
(#42210772)
Which makes it entirely irrelevant as a descriptive term.