Re:AI: Accelerated Incompetence
by latentnumber on Wednesday May 28, 2025 @09:06AM
(#44115610)
I would agree with this if the LLM never really modified the initial linear embeddings, but non-linearity in MLP layers and position/correlation fixing in the attention layers would mean that things are not so simple. I’m pretty sure there are papers showing compositionality and so on being represented by transformers.
[ Parent
| on HN ]
There are no comments on this comment yet.