Re:Transformers struggle with generalizing tasks beyond pre-...
by GaggiX on Tuesday November 07, 2023 @12:38PM
(#38180005)
The model is trained with a fixed number of tokens, I think it would cause problems with the sinusoidal embeddings layer.
[ Parent
| on HN ]
There are no comments on this comment yet.