News for hackers. Stuff that matters.
Re:Internal representations of LLMs encode information about... by youoy on Wednesday October 30, 2024 @05:28PM (#42000577)
What I meant is that I can imagine cases where some part of the dataset may look like R2 and then colapse to have a spike that looks like R1, so it is not a standard manifold where all of it has the same dimension.

Appart from that, these "manifolds" have noise, so that is another difference with the standard manifolds.

There are no comments on this comment yet.