News for hackers. Stuff that matters.

A comment on Show HN: Llama 3.2 Interpretability with Sparse Autoencoders. Parent comment

Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by sinuhe69 on Friday November 22, 2024 @04:04AM (#42212253)
What is a casual thought that you cannot explain in math?
[ Parent | on HN ]
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by TeMPOraL on Friday November 22, 2024 @05:25AM (#42212620)
That question makes no sense. You can explain anything in math, because math is a language and lets you define whatever terms and axioms you need at a given moment.

(Whether or not such explanation is useful for anything is another issue entirely.)

[ Parent | on HN ]
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by worldsayshi on Friday November 22, 2024 @06:34AM (#42212963)
Can you explain how intuition led you to try a certain approach?
[ Parent | on HN ]
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by TeMPOraL on Friday November 22, 2024 @07:35AM (#42213323)
Is it enough if I hand-wave it with probability distributions, or do you want me to write out adjacency search in a high-dimensional space?
[ Parent | on HN ]