News for hackers. Stuff that matters.
Re:OpenAI raises $110B on $730B pre-money valuation by generallyjosh on Sunday March 01, 2026 @09:10AM (#47206836)
Larger models need more hardware resources to run

And, depending on effort settings, they do more 'thinking', i.e., use more rounds of inference to generate longer internal chains of thought

Both very good reasons to prefer a smaller model, if the small model is good enough for the task

There are no comments on this comment yet.