Re:01-AI/Yi: A series of large language models trained from ...
by light_hue_1 on Monday November 06, 2023 @12:48PM
(#38165927)
From scratch simply means that they didn't base it off some other llm.
This is perfectly good language and exactly the correct thing for them to say.
There are 2873 results that contain "large language model" in the full text and use "pretrained" in the title or abstract. A 10x difference in publication count does make one feel more common than the other?
I'd need to get into more involved queries to break down the semantic categories of those papers.