Yet the models do not (yet) reason. Try to ask them to solve a programming puzzle or exercise from an old paper book that was not scanned. They will produce total garbage.

Models work across programming languages because it turned out programming languages and API are much more similar than one could have expected.