Code generation models tend to much more often regurgitate code from the training data compared to one of these image based models regurgitating images from the training data.

Code generation models need to have special handling for checking if the generated code falls under copyright.