News for hackers. Stuff that matters.
Re:The new skill in AI is not prompting, it's context engine... by silveraxe93 on Tuesday July 01, 2025 @06:15AM (#44432360)
It's ironic how people write this without a shred of reasoning. This is just _wrong_. LLMs are not simply token prediction machines since GPT-3.

During pre-training, yeah they are. But there's a ton of RL being done on top after that.

If you want to argue that they can't reason, hey fair be my guest. But this argument keeps getting repeated as a central reason and it's just not true for years.

There are no comments on this comment yet.