It all boils down to having some sort of embodiment, or a way to verify. For code it would suffice to let the model generate and execute code, and learn from errors. Give it enough "experience" with code execution and it will learn on its own, like AlphaGo. Generate more data and retrain the models a few times.