News for hackers. Stuff that matters.
Re:Building a Virtual Machine Inside ChatGPT by astrange on Saturday December 03, 2022 @07:50PM (#33849269)
“Good” isn’t expressed in code here. GPT3 was trained on a very loose problem (next word prediction). InstructGPT/ChatGPT are trained on reinforcement learning from human raters.

If it was all a computer program it’d be acting like ELIZA.

Re:Building a Virtual Machine Inside ChatGPT by Xelynega on Sunday December 04, 2022 @06:24PM (#33859190)
"good" for gpt was expressed in the way they chose the dataset to include.

Just because generative text models in the past(like ELIZA) were bad doesn't mean that the algorithms we have now are much more than better versions of the same.