News for hackers. Stuff that matters.

A comment on TinyStories: How Small Can Language Models Be and Still Speak Coherent English? (2023). Parent comment

Re:TinyStories: How Small Can Language Models Be and Still S... by seattleeng on Thursday January 02, 2025 @08:56PM (#42581358)
As is usually the case, check the data! A lot of the dataset used has fairly morbid scenarios, so the model is working as expected. All the data was synthetically created with GPT4
[ Parent | on HN ]

There are no comments on this comment yet.