News for hackers. Stuff that matters.
Re:OPT: Open Pre-trained Transformer Language Models by astrange on Monday May 02, 2022 @11:10PM (#31244064)
GPT3 will do that right now. There aren’t any controls on its text, it just warns you if it looks offensive. And of course nothing it says is true except coincidentally.

If you've seen GPT-3 interviews (https://twitter.com/minimaxir/status/1513957106868637696) it'll happily say some wild stuff. As a mild example I recommend interviewing "a man who is currently beating you up".

Re:OPT: Open Pre-trained Transformer Language Models by dukeofdoom on Monday May 02, 2022 @11:49PM (#31244351)
Is it true to say they are true coincidentally, because that kind of suggests randomly true. I understand the AI doesn't really comprehend if something is true or false. My understanding is the results are more than random, maybe something closer to like weighted opinion.
Re:OPT: Open Pre-trained Transformer Language Models by therealcamino on Tuesday May 03, 2022 @08:39AM (#31247549)
What it returns is based on what it's trained on. If it's trained on a corpus containing untruths and prejudice, you can get untruths and prejudice out. You can't make conclusions about what beliefs are widely held based on what it generates in response to specific prompts.

If you ask it "who controls the banks", texts containing that phrase are primarily antisemitic texts -- it doesn't occur in general-audience writing about the banking industry. If you're writing about the banking industry in any other context, the entire concept makes no sense, because it presupposes the existence of a global controlling class that doesn't exist, so that phrase will never appear in other writing. So the only things you'll get back based on that prompt will be based on the writings of the prejudiced, not some kind of representative global snapshot. Taking that as evidence of "weighted opinion" doesn't make sense.

Re:OPT: Open Pre-trained Transformer Language Models by hedora on Tuesday May 03, 2022 @12:17AM (#31244552)
Weighted random is still random.