News for hackers. Stuff that matters.
Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by PaulPauls on Friday November 22, 2024 @01:18PM (#42216112)
Just bad wording from me, trying to combine too much information in 1 sentence. The auxiliary loss is supposed to prevent dead latents from occuring in the first place - therefore "prevent dead latents" - and it is also supposed to revive the latents that are already dead - therefore "revive dead latents".

Now that I review that sentence again I see that I used 2 verbs on the same subject that could be interpreted differently depending on the verb. Me culpa. I hope you still gained some insights into it =)

Re:Show HN: Llama 3.2 Interpretability with Sparse Autoencoders by imranhou on Friday November 22, 2024 @05:08PM (#42217763)
Thanks for sharing! It is certainly interesting to me who is not in the mainstream, I'm sure your intended audience understood what you were saying.