News for hackers. Stuff that matters.
Re:Teaching LLMs how to solid model by sharemywin on Thursday April 24, 2025 @09:34AM (#43782569)
isn't it closer to concept prediction layered over top of text prediction because of the multiple levels? it compresses text into concepts using layers of embeddings and neural encoding then predicts the concept based on multiple areas of attention. then decompresses it to find the correct words to convey the concept.

There are no comments on this comment yet.