News for hackers. Stuff that matters.
Re:Tencent's 'Hunyuan-T1'–The First Mamba-Powered Ultra-Larg... by kristjansson on Sunday March 23, 2025 @01:15PM (#43454274)
Each token requires the same amount of compute. To a very crude approximation, model performance scales with total compute applied to the task. It’s not absurd that producing more tokens before an answer improves performance, in a way that’s akin to giving the model more time (compute) to think.

There are no comments on this comment yet.