News for hackers. Stuff that matters.
Re:Building a Virtual Machine Inside ChatGPT by jameshart on Saturday December 03, 2022 @07:06PM (#33848937)
What I find weird is that it generates well structured, well commented code.

Where is this massive repository of well structured code with good clear variable names that it’s tapping into?

Re:Building a Virtual Machine Inside ChatGPT by clolege on Saturday December 03, 2022 @07:08PM (#33848961)
Right. It must be weighting repos with more stars more heavily in this case, right?
Re:Building a Virtual Machine Inside ChatGPT by visarga on Saturday December 03, 2022 @07:33PM (#33849140)
You could see it as factorised skill learning. In one place it learns how to do some task, in another place it learns how to write nice code, then does both at the same time. It learns all the possible code styles and purposefully uses a good style because it has been taught to choose so - with reinforcement learning from human preferences.
Re:Building a Virtual Machine Inside ChatGPT by int_19h on Sunday December 04, 2022 @12:19AM (#33850851)
Maybe it just read all the StackOverflow comments about using clear, expressive names as identifiers, and then unlike most humans, it actually took them seriously? ~