News for hackers. Stuff that matters.

A comment on Gemma 3 270M: The compact model for hyper-efficient AI. Parent comment

Re:Gemma 3 270M: The compact model for hyper-efficient AI by imp0cat on Friday August 15, 2025 @03:34AM (#44909585)
It does not work that way. The model does not "know". Here is a very nice explanation of what you are actually dealing with (hint: it's not a toddler-level intelligence): https://www.experimental-history.com/p/bag-of-words-have-mer...

    instead of seeing AI as a sort of silicon homunculus, we should see it as a bag of words.
[ Parent | on HN ]
Re:Gemma 3 270M: The compact model for hyper-efficient AI by 4b11b4 on Friday August 15, 2025 @05:39PM (#44917549)
even though I have heard of the bag of words before, this really struck on something I've been searching for

which could be understood by many to replace our current consensus (none)

[ Parent | on HN ]