News for hackers. Stuff that matters.
Re:Teuken-7B-Base and Teuken-7B-Instruct: Towards European LLMs by vjerancrnjak on Tuesday April 15, 2025 @09:09AM (#43692157)
Exactly. I found it surprising how soon it was implied "Imagine you're the smartest and most creative person in the world, ..." would somehow result in the most creative output.

It's clear from the start that language modelling is not yet there. It can't reason about low level structure (letters, syllables, rhyme, rhythm), it can't map all languages to a singular clear representation. Representation is mushy distributed mess out of which you get good or bad results.

It's brilliant how relevant the responses are and when they're correct, but the underlying process is driven by very weird internal representations.

There are no comments on this comment yet.