News for hackers. Stuff that matters.
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by calebkaiser on Tuesday August 25, 2026 @10:09PM (#49443330)
Google rolled out TPUs in 2015. AWS released Inferentia and Trainium chips in 2020.

If companies working on ML-specific chips was evidence that large transformer models have fully saturated their potential, the field would have been done circa GPT-2.

Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by edgyquant on Wednesday August 26, 2026 @09:45AM (#49449085)
Neither of those companies core business model was serving llms
Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by calebkaiser on Wednesday August 26, 2026 @12:21PM (#49451708)
What? Both of those companies absolutely serve LLMs, and both of them would love for serving LLMs to be an even bigger part of their business. Not only that, AWS is Anthropic's primary compute partner for training and inference. They literally use the newest generation of the Trainium chips I mentioned before: https://www.anthropic.com/news/anthropic-amazon-compute

Chips are another axis for improvements in training and inference. Orgs large enough to explore the space have been doing it for at least a decade now. This is just a silly line of reasoning based on the faulty assumption that somehow, looking for increases in efficiency in training/inference means teams have reached some theoretical limit in model capability.

Re:OpenAI JalapeñO: Better Than Nvidia Blackwell by edgyquant on Thursday August 27, 2026 @11:04AM (#49466047)
Notice how I used the words “core business” but that they didn’t do business at all