News for hackers. Stuff that matters.
Re:Don't be a meat proxy by dandiep on Monday August 03, 2026 @02:33AM (#49151969)
Why are LLMs producing this super tense text more often now? Is it because they are being optimized to use fewer tokens?
Re:Don't be a meat proxy by vanviegen on Monday August 03, 2026 @02:42AM (#49152027)
I think they're overcorrecting for being too long-winded in previous generations (and still, in some cases). I guess this is a hard balance to get right.
Re:Don't be a meat proxy by Davidzheng on Monday August 03, 2026 @02:58AM (#49152135)
I'm pretty sure the other answers are wrong and it's a side effect of RL (see thinking machines post about inkling training). It's also exacerbated in fable and sol--I think it's token efficiency effect--bc it's about to reason with fewer tokens the density of the token information goes up.
Re:Don't be a meat proxy by conception on Monday August 03, 2026 @02:36AM (#49151988)
I figure they are being optimized to write code/functions and not prose so all text is getting more code like.
Re:Don't be a meat proxy by zahlman on Monday August 03, 2026 @02:52AM (#49152090)
ChatGPT is still plenty verbose by default IMX.