Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by nightski on Monday July 20, 2026 @07:59PM
(#48986457)
Except LLMs are not stochastic in nature. Correct me if I am wrong, but it's just the final layer which outputs a distribution across the output tokens. In reality, the rest of the model is deterministic.
This is not like a bayes model or something were it's distributions all the way down.
Yesterday there's a news on a breakthrough for probabilistic computer (UxHw) with 1 million p-bits [1].
Since LLM is stochastic in nature, this type of new computer can be much better than ASIC for processing LLM data.
[1] Biggest Probabilistic Computer Turns Noise into Answers:
https://news.ycombinator.com/item?id=48971938