News for hackers. Stuff that matters.
Re:The Fractured Entangled Representation Hypothesis by goldemerald on Tuesday May 20, 2025 @03:07PM (#44044816)
That is addressing the incomprehensibility of PCA and applying a transformation to the entire latent space. I've never found PCA to be meaningful for deep learning. As far as I can tell, polysemous issue with neurons cannot be addressed with a single linear transformation. There is no sparse analysis (via linear probes or SAEs) and hence the unaddressed issue.

There are no comments on this comment yet.