News for hackers. Stuff that matters.
Re:01-AI/Yi: A series of large language models trained from ... by Mougatine on Monday November 06, 2023 @08:49AM (#38162522)
"From scratch" is commonly used in the field.
Re:01-AI/Yi: A series of large language models trained from ... by popinman322 on Monday November 06, 2023 @09:10AM (#38162773)
Among arxiv publications there are 217 results that contain "large language model" in the full text and "from scratch" in the title or abstract.

There are 2873 results that contain "large language model" in the full text and use "pretrained" in the title or abstract. A 10x difference in publication count does make one feel more common than the other?

I'd need to get into more involved queries to break down the semantic categories of those papers.

Re:01-AI/Yi: A series of large language models trained from ... by light_hue_1 on Monday November 06, 2023 @12:48PM (#38165927)
From scratch simply means that they didn't base it off some other llm.

This is perfectly good language and exactly the correct thing for them to say.