When you say upsetting things to bing chat, you'll find the conversation prematurely end.
You can cry all you want about how bing isn't really upset. How it doesn't really have intention to end the chat but those are evidently useless defitions because the chat did end.
A definition that treats Bing as an intentful system is more accurate to what happens in reality.
It is useful for anyone looking to use such systems. A LLM piloted robot could potentially pick up a knife and stab you because you obstructed some goal or said mean words and pretending it didn't have intent to do so won't bring you back to life. Acting like it does could help avoid such a scenario.
>You could equally pretend the sun sets every night because it's upset from shining all day.
No you couldn't.
The conversation ended prematurely because of your input. There is zero ambiguity on the relation.
But because you ascribe intent to bing, you can predict (accurately) that saying nice things will not end the conversation.
That would describe quite a lot of ancient religious beliefs about the Sun
I'd add though that inference is clearly fixed but there is some more subtlety about training. Gradient descent clearly doesnt have intelligence, intent (in the sense meant), consciousness either, but it's not stateless like inference and you could argue has a rudimentary "intent" in minimizing loss.