News for hackers. Stuff that matters.
Re:OpenAI Sold its Soul for $1B (2021) by pixl97 on Wednesday March 15, 2023 @04:24PM (#35174225)
>But what happens when the software you design can accept and return billions of possible parameters? There is simply no way of determining what the output is

Welcome to the trillion dollar AI safety question and the reason some experts are deeply concerned that we'll solve general intelligence long before we're ready to deal with the outcome of what general intelligence can do.

This is why we talk about the AI alignment issue. GPT-3/GPT-4 without a RLHF in front of it is mostly a weird alien that doesn't behave in a generally useful manner. This is why Chat/BingGPT took off recently because we put a pretend human mask in front of the monster. But behind that mask is the internet, jumbled up and thrown in a neural network blender. Unless they did a lot of filtering, there is also all the things that we'd consider generally bad, like if for example your teacher started telling your kids the proper method of smoking crack.

There are no comments on this comment yet.