News for hackers. Stuff that matters.
Re:TinyStories: How Small Can Language Models Be and Still S... by og_kalu on Tuesday May 16, 2023 @08:56AM (#35961214)
Basically Tiny Language Models (below 10m parameters or only one transformer block) can generate paragraphs of coherent text and reason....provided training is limited to stories that only contain words typical 3 to 4 year olds would understand.

There are no comments on this comment yet.