News for hackers. Stuff that matters.
Re:OpenAI O3-Mini by Eduard on Friday January 31, 2025 @04:55PM (#42892633)
3.3612 cents (I guess USD cents) is expensive!
Re:OpenAI O3-Mini by BoorishBears on Friday January 31, 2025 @06:16PM (#42893560)
Same immediate thought: the free option I provide on my production site is a model that runs on 2xA40. That's 96GB of VRAM for 78 cents an hour serving at least 4 or 5 concurrent requests at any given time.

O3 Mini is probably not a very large model and OpenAI has layers upon layers of efficiencies, so they must be making an absolute killing charging 3.3 cents for a few seconds of compute