News for hackers. Stuff that matters.
Re:Some thoughts on LLMs and software development by seunosewa on Saturday August 30, 2025 @04:23AM (#45072917)
The LLM objective is whatever they are trained to do, whether it's completing text, obeying instructions, coding, etc.

In pre-training, we drop a lot of human-written text in them. This allows them to learn the rules of language and grammar and common language patterns. At this stage, the objective is to predict the next token that makes sense to human beings.

Examples: The capital of US is ... Why did the chicken ...

The next step is instruct training, where they are trained to follow instructions. At this point, they are predicting the next token that will satisfy the user's instructions. They are rewarded for following instructions.

Next step, they are trained to reason by feeding them with reasoning examples to get them going, and then rewarding them whenever their reasoning leads them to good answers. They learn to predict the next reasoning token that will lead them to the best answers.

The objective is imparted by their training. They are "rewarded" when their output satisfies the objective, so that as they are trained, they get better and better at achieving the objectives of the training.

Re:Some thoughts on LLMs and software development by scott_w on Sunday August 31, 2025 @08:19AM (#45082617)
> The LLM objective is whatever they are trained to do, whether it's completing text, obeying instructions, coding, etc.

That’s not an objective of the LLM, it’s an objective of the human creating, training and using it. The LLM is a tool to achieve that objective.