News for hackers. Stuff that matters.
Re:Transformers struggle with generalizing tasks beyond pre-... by telotortium on Tuesday November 07, 2023 @12:35PM (#38179959)
Not with GPT-4-Turbo 128k, at least if attention works as well at that context size as on smaller ones.

There are no comments on this comment yet.