Re:The Unbearable Cheapness of Open Weight Models
by dathanb82 on Friday June 26, 2026 @01:27AM
(#48682654)
If "inference is cheap," why is OpenAI spending a ton getting Broadcom to design custom AI chips that make inference cheaper? Reports suggest their custom silicon isn't all that good for training, it's all to make inference more efficient. That shouldn't be necessary if inference is already quite cheap.
[ Parent
| on HN ]