At what point in the system?

If you have an LLM that was trained on (say) everything on the internet except for programming, and then trained it on the Python.org online documentation, would that be enough for it to start programming Python? I've not tried, but I get the impression that it needs to see lots and lots of examples first.

No, absolutely not. A lot of docs are old, missing code examples, very narrow, etc.