News for hackers. Stuff that matters.
Re:Hybrid Reasoning Agents: LLM agents that think in latent ... by bhattisatish on Sunday October 18, 2026 @05:33PM (#50145696)
Re:Hybrid Reasoning Agents: LLM agents that think in latent ... by octoberfranklin on Sunday October 18, 2026 @09:24PM (#50147270)
The first question that leapt into my mind, and I imagine the minds of other readers, is "what makes this an improvement over continuous chain of thought"?

I did manage to find one sentence in the paper that tries to address this question -- but it consists of nothing more than two unjustified assertions, both of which are dubious:

Unlike decoded text, continuous latent vectors (i) lack native pathways for tool invocation across multi-turn agentic reasoning (Chang et al., 2026), and (ii) do not readily expose human-interpretable semantics, leaving them difficult to supervise during training (Chen et al., 2026) and to audit or debug at inference (Korbak et al., 2025).

The latent space in a continuous chain of thought model is the same space the tokens are embedded into, just like an ordinary transformer. They make tool calls exactly the same way that an ordinary transformer does: by leaving thinking mode and emitting chat tokens (which get sampled as probability distributions in the image of the embedding function). The difference is quite simple: chat tokens are noncontinuous, and toolcall tokens are a subset of the chat tokens. Thinking tokens are the only ones which are continuous, and toolcalls don't happen in thinking mode in any model I've ever seen (maybe one exists; if it does it would be weird and interesting!).

As for human-interpretability, yeah, that's the tradeoff. Continuous chain of thought thinking tokens are not-obviously-interpretable, just like Hybrid Reasoning Agents "latent mode". I'm not seeing a win here.

Re:Hybrid Reasoning Agents: LLM agents that think in latent ... by lukev on Sunday October 18, 2026 @10:26PM (#50147673)
I’m sorry, perhaps I’m behind the times here, but do frontier models currently use continuous (arbitrary embedding) thinking tokens? I know a bunch of papers on the topic came out late last year but to my knowledge have not been successfully implemented into the SOTA yet.

I know the biggest/best open models don’t use continuous thinking tokens, and while the big labs keep things proprietary, I don’t think we have evidence yet that they are.

If I’m wrong please point me in that direction, I’d love to read up on it. Using continuous embeddings in CoT has always seemed obvious to me but doesn’t seem to be as simple as that.

Re:Hybrid Reasoning Agents: LLM agents that think in latent ... by londons_explore on Monday October 19, 2026 @01:12AM (#50148606)
The big closed labs encrypt their thinking tokens when sent to the user, but by the number of bytes of that encrypted blob, I suspect it is non-continuous. If it were continuous, the vector would have to be very small or low bit depth.