Re:Mercury Coder: frontier diffusion LLM generating 1000+ to...
by volodia on Wednesday February 26, 2025 @06:55PM
(#43189713)
Yes, we plan to be releasing a tech report soon. We are not open sourcing the models at launch time, but we have a roadmap of future releases in which we hope to make some of our models accessible to the research community.
Without a full paper, it's a bit hard to understand the full details. Does this essentially replace nucleus sampling with diffusion, or does it change the "core" transformer architecture in a major way?