RNNs are good at learning the structure of their training input—even character-level networks can output vaguely plausible English. Of course, what you end up with often looks like a computational model of a thought disorder. They have seemingly lucid moments, but so do Markov chain generators.

As far as code goes, we've already solved the problem of modeling the structure of any programming language with an implementation. That's not the hard part.