Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone
by anonzzzies on Sunday March 02, 2025 @05:11AM
(#43229005)
The LLMs want to please, they can infinitely keep making 'important' changes; changing variable names without changing anything else, adding/removing comments, adding removing print statements, moving a function somewhere in the code (usually by first duplicating it) and fixing perfectly fine code with 'let me see if everything is really working' (it was and now it's broken again).
[ Parent
| on HN ]
Re:Making o1, o3, and Sonnet 3.7 Hallucinate for Everyone
by derefr on Sunday March 02, 2025 @01:59PM
(#43233722)
"Wanting to please" is just fine-tuned implicit prompt stuff, though. You can tell the LLM that it's roleplaying as a senior engineer, and should consider you, the human to be a junior engineer it works with, who is asking it for advice. You can just leave it at that (often works, if the AI knows enough about how software is produced); or you can describe particular traits of senior engineers — e.g. "wants code that works" and "knows when to say the code is good enough and that the junior is now wasting time by fiddling with it."