Re:Building a Virtual Machine Inside ChatGPT
by clolege on Saturday December 03, 2022 @07:08PM
(#33848961)
Right. It must be weighting repos with more stars more heavily in this case, right?
Re:Building a Virtual Machine Inside ChatGPT
by visarga on Saturday December 03, 2022 @07:33PM
(#33849140)
You could see it as factorised skill learning. In one place it learns how to do some task, in another place it learns how to write nice code, then does both at the same time. It learns all the possible code styles and purposefully uses a good style because it has been taught to choose so - with reinforcement learning from human preferences.
Where is this massive repository of well structured code with good clear variable names that itβs tapping into?