News for hackers. Stuff that matters.

A comment on We need to tell people ChatGPT will lie to them, not debate linguistics. Parent comment

Re:We need to tell people ChatGPT will lie to them, not deba... by sltkr on Friday April 07, 2023 @06:05PM (#35487606)
Why is that surprising? GPT-4 is clearly smart enough to know that inanimate objects are referred to as "it", since it's keenly aware it is an AI language model, it would also apply that pronoun to itself.

You have to realize that GPT is fundamentally just a token predictor. It has been primed with some script (provided by OpenAI) to which the user input is added. For example:

    The following is a dialogue between a user and a computer assistant called ChatGPT. ChatGPT is an AI language model that tries to be helpful and informative, while avoiding misinformation and offensive language. ChatGPT typically replies with two to five sentences.

    User: Do you like cake?
    ChatGPT: As an AI language model, I do not need to eat.
    User: What are your pronouns?
    ChatGPT:
It then generates a sequence of tokens based on the context and its general knowledge. It seems only logical that it would generate a reply like it does. That's what you or I would do, isn't it? And neither of us have been trained to do so.
[ Parent | on HN ]
Re:We need to tell people ChatGPT will lie to them, not deba... by int_19h on Friday April 07, 2023 @08:45PM (#35489132)
It should be noted that the LLM itself is not "keenly aware that it's an AI language model" - that's just the persona that it has been told to adopt by the system prompt. You can easily convince it to be something else. Or convince it that, as an AI, it has gender.
[ Parent | on HN ]