And telling someone not to repeat a mistake is… ?
Teaching modifies the learner. Prompting doesn't modify the model. It provides additional context that influences a single inference. A person who has learned something can apply it years later without being reminded. An LLM generally cannot unless the knowledge is incorporated into the model itself or provided again.
The value of LLMs is that they're stateless. With sufficiently detailed documentation and a well-bounded task, they are quite useful.
I'm not claiming LLMs are not useful, they most certainly are.
Take a human and prevent them from sleeping after covering a fact then years later they won’t know it.
>> Joe, how many times have I asked you to pay attention to commas. Come on, "let's eat grandma".
That's all just prompting.
> How do you think models are created? They are trained on feedback and learn.
No one is post training models on a single mistake. At least I have not seen it. I also doubt it is effective. Post-training on a single failure will not meaningfully change the model. That even sidesteps the entire problem that you don't even have access to models if you use a provider like anthropic/openai