Internal representations of LLMs encode information about truthfulness

Re:Internal representations of LLMs encode information about... by youoy on Wednesday October 30, 2024 @01:47PM (#41998107)

I think "manifolds" in AI are not the same as actual smooth manifolds. For starters I would not expect them to have locally the same dimension across the whole dataset.

[ Parent | on HN ]

Re:Internal representations of LLMs encode information about... by ottaborra on Wednesday October 30, 2024 @04:45PM (#42000066)

Something to chew on for me. But what is a manifold then if not a topological space that is locally the same as R^(some dimension) ?

[ Parent | on HN ]

Re:Internal representations of LLMs encode information about... by youoy on Wednesday October 30, 2024 @05:28PM (#42000577)

What I meant is that I can imagine cases where some part of the dataset may look like R2 and then colapse to have a spike that looks like R1, so it is not a standard manifold where all of it has the same dimension.

Appart from that, these "manifolds" have noise, so that is another difference with the standard manifolds.

[ Parent | on HN ]