News for hackers. Stuff that matters.
Re:A History of Large Language Models by lispybanana on Wednesday October 15, 2025 @01:00AM (#45588237)
How does NN create a concept not in its training data? (Does it explore negative idea-space?) What if a concept uses a word not yet invented? How does LLM produce that word and what cosine similarity would such a word have if it's never appeared next to others? How would we know if such a word is useful?

There are no comments on this comment yet.