Every story and comment from the Hacker News API, in a layout borrowed from 2001.
A comment on ARC-AGI without pretraining. Parent comment
And no, I don't think the knowledge of language is necessary. To give a concrete example, tokens from TinyStories dataset (the dataset size is ~1GB) are known to be sufficient to bootstrap basic language.
There are no comments on this comment yet.
And no, I don't think the knowledge of language is necessary. To give a concrete example, tokens from TinyStories dataset (the dataset size is ~1GB) are known to be sufficient to bootstrap basic language.