Oops, HybridLink as a paper came out little bit ago, and it was an architecture I more or less converged on in my own work. JEPA is the obvious successor to autoregression once you look at it a little bit - to the extent that you can take a non-jepa transformer and just slap a couple things on it to make it a latent reasoner without crossing the token boundary. It's faster and more accurate, as you would expect from not having to project down to tokens and have the model reconstruct its own latents.