News for hackers. Stuff that matters.
Re:OpenAI declares 'code red' as Google catches up in AI race by bloppe on Tuesday December 02, 2025 @06:12PM (#46128232)
The best way to drive inference cost down right now is to use TPUs. Either that or invest tons of additional money and manpower into silicon design like Google did, but they already have a 10 year lead there.
Re:OpenAI declares 'code red' as Google catches up in AI race by littlestymaar on Wednesday December 03, 2025 @03:13AM (#46131560)
> The best way to drive inference cost down right now is to use TPUs

TPUs are cool, but the best leverage remains to reduce your (active) parameters count.