News for hackers. Stuff that matters.
Re:The Unbearable Cheapness of Open Weight Models by dathanb82 on Friday June 26, 2026 @01:27AM (#48682654)
If "inference is cheap," why is OpenAI spending a ton getting Broadcom to design custom AI chips that make inference cheaper? Reports suggest their custom silicon isn't all that good for training, it's all to make inference more efficient. That shouldn't be necessary if inference is already quite cheap.
Re:The Unbearable Cheapness of Open Weight Models by petra on Friday June 26, 2026 @04:50AM (#48684112)
A large part of the market will be ad based. For that, having the lowest cost inference is useful.

Also for agent doing r&d, cheaper tokens allows doing more, which is always good.