Re:Eurostar AI vulnerability: when a chatbot goes off the rails
by immibis on Sunday January 04, 2026 @07:56PM
(#46494132)
It's not about delivering punishment. It's about suppressing certain responses. If the model is trained seeing that responses using don't contain things that previous messages say will be punished then that is a valid way to deprioritize those responses.
[ Parent
| on HN ]
There are no comments on this comment yet.