News for hackers. Stuff that matters.
Re:StarCoder and StarCoderBase: 15.5B parameter models with ... by viraptor on Monday May 15, 2023 @11:23PM (#35957421)
You get a lot more context though. The training set is just "here's lots of code and some comments and docs". You trained on your own experience with interface, your process expectations as a human in real world, on the whole chains of "we need to achieve this, so we're splitting it into those tasks", and many other related contexts.

In RPG terms, the models put everything into intelligence and no points into wisdom.

Re:StarCoder and StarCoderBase: 15.5B parameter models with ... by mr_toad on Monday May 15, 2023 @11:29PM (#35957465)
I suspect that the reason that people find declarative and functional programming more difficult is that they have to ‘unlearn’ a lot of procedural thinking that we get from real world experience.