> The equivalent would be learning to write software by looking at compiled binaries.

Only if Copilot was issuing compiled binaries. In this case the end result is the code.