Re:TinyStories: How Small Can Language Models Be and Still S...
by og_kalu on Tuesday May 16, 2023 @08:56AM
(#35961214)
Basically Tiny Language Models (below 10m parameters or only one transformer block) can generate paragraphs of coherent text and reason....provided training is limited to stories that only contain words typical 3 to 4 year olds would understand.
[ Parent
| on HN ]
There are no comments on this comment yet.