News for hackers. Stuff that matters.
Re:DALL-E 3: Improving image generation with better captions... by tobr on Friday October 20, 2023 @06:48AM (#37954478)
This is an aside, but in general, aren’t tokens a pretty bad hack to improve context length? I don’t know enough about the theory to say, but it seems like it should make all kinds of things much more fragile, like how well it can understand misspellings, or languages that don’t map well to the tokens available.

There are no comments on this comment yet.