Agree, Mercury 3 is one of my favorite models right now...the speed is such a quality of life improvement.

Really? I'm surprised. What do you use it for?

My read on Diffusion LLMs has been that it's cool tech, but only useful for things like like code autocomplete or editing a block of text.

They don't beat autoregressive models on quality per compute, assuming you are serving lots of users and can batch requests.

MoA schemes that use proposers/task-separation/supervisory roles can still benefit from very fast diffusion models like mercury, the overall speed doesn't have to be bottle-necked by the slowest model -- that depends on the arrangement it's deployed in.

but to your point , yeah diffusion models can be kind of brain dead without proper coaxing.

I just use it for normal coding stuff.

It's not as good as the current frontier, to be fair. I don't use it to help me think through architecture, for example. But I have found to work well for at least like half of coding tasks once architecture and patterns are in place. Its advantage is that it's very very fast.

Sorry to put it bluntly, but, Mercury is sh*t in comparison. And I have genuinely tried a few times to use it since the speed is so good. But nop.. it just isn't there.

For my own purposes, I found Mercury Decide to be excellent. Better than Jev at what I threw at it. Inception did a really great job with it.

Thanks for your review, 15 day old HN account that likes praising Mercury services.

I'm not affiliated with them at all. yeah I like them, and yeah I like to compare decision models at the moment.

Don't believe me? Google my name.

May I add Poolside (Laguna S) to this? Used them extensively during their free trial (sadly now apparently over).-