Re:Transformers struggle with generalizing tasks beyond pre-...
by craftit on Thursday November 09, 2023 @03:58AM
(#38202632)
From what I understand, it can learn and execute the algorithm fairly reliably, though it won't be 100%. When the LLM generates text, it is randomised a little, as well as some tricks that prevent repetition, which would likely cause problems with numbers containing all the same digit.
[ Parent
| on HN ]
There are no comments on this comment yet.