Google Invests Almost $400M in ChatGPT Rival Anthropic

Re:Google Invests Almost $400M in ChatGPT Rival Anthropic by visarga on Sunday February 05, 2023 @06:54AM (#34664147)

I think a token effort to avoid offensive content is ok, but chatGPT should quickly detect if the human wants to go outside the box and allow it. If a human pushes it means they understand the risks and take full responsibility for the outcome.

[ Parent | on HN ]

Re:Google Invests Almost $400M in ChatGPT Rival Anthropic by rvnx on Sunday February 05, 2023 @07:05AM (#34664215)

This is not how Google's AI Test Kitchen is designed. AI Test Kitchen seems quite boring and very framed system, where you can ask what is the best Dyson model for example, or the old-style "GPT dungeon game", it doesn't really go off-rail (this is part of the product specifications sadly :/).

[ Parent | on HN ]

Re:Google Invests Almost $400M in ChatGPT Rival Anthropic by LoganDark on Sunday February 05, 2023 @07:07AM (#34664227)

> chatGPT should quickly detect if the human wants to go outside the box and allow it

This is why "jailbreaking" is a thing. Once you convince the model that it's OK, it'll let you do anything from then on.

-Emily

[ Parent | on HN ]

Re:Google Invests Almost $400M in ChatGPT Rival Anthropic by criley2 on Sunday February 05, 2023 @07:14AM (#34664277)

I couldn't disagree more. ChatGPT would be extremely easy to convert to "HateGPT", and would be able to create some pretty powerful and useful political, racial, etc propaganda.

I think it's right that the owners understand what the weaponization of ChatGPT could do and prevent it, and I think we need laws (and fast) before weaponized AI like ChatGPT turns into a disaster for humanity

[ Parent | on HN ]