unless you are doing something where you stay in latent space without having a random number generator pick a word, the next token predictor part still matters. without making the tokes concrete in between, that plan doesnt exist

if it was designed to edit code, id expect the first translation from latent space out to tokens to be the final code, not be assembling the code by random number generator.

its not really designed to edit code until the tests succeed, we try to manipulate the distribution of tokens to predict by prompt engineering with the test results.