News for hackers. Stuff that matters.
Re:OpenAI unveils its first custom chip, built by Broadcom by simondotau on Thursday June 25, 2026 @02:16AM (#48669658)
Presumably at some point the rapid progress of models will plateau, at least insofar as a model could be frozen in time and remain economically useful for the expected life of hardware. Especially if it comes with compelling benefits e.g. dramatically lower latency and/or dramatically higher performance per watt.

If you can build chips that could run one specific LLM 100x faster than anything else, it would have a use case that nothing else could match.

Re:OpenAI unveils its first custom chip, built by Broadcom by fragmede on Thursday June 25, 2026 @03:38AM (#48670195)
https://www.cerebras.ai/ is exactly that! Holy shit it's fast.
Re:OpenAI unveils its first custom chip, built by Broadcom by otterley on Thursday June 25, 2026 @08:15AM (#48672253)
Cerebras is not that. Cerebras isn’t tied to a particular model like Taalas is. The latter is even faster than Cerebras.
Re:OpenAI unveils its first custom chip, built by Broadcom by jwHollister on Thursday June 25, 2026 @08:22PM (#48680935)
Yeah at a certain point if inference is fast and cheap, do I care if it's the smartest? I can iterate in a tighter loop.
Re:OpenAI unveils its first custom chip, built by Broadcom by lsaferite on Thursday June 25, 2026 @09:43AM (#48673280)
Those taalus chips apparently run at 1/10 the power as the current SOTA GPU setups. If they can execute even partially on their plan, it'll be a literal game changer.