News for hackers. Stuff that matters.
Re:OpenAI Needs $400B In The Next 12 Months by moomoo11 on Friday October 17, 2025 @03:20PM (#45620883)
For actual work and not toying around the 10% gap is absolutely worth the cost.
Re:OpenAI Needs $400B In The Next 12 Months by 999900000999 on Friday October 17, 2025 @03:40PM (#45621112)
You may be correct, but for my hobbyist projects I tend to use the cheaper models to get started, and then I'll switch to a more expensive one if the cheaper model gets stuck.

Unless the actual race is to create an AI Employee that operates and can deliver work without constant supervision. At that level, of course it would be cheaper to pay $2,000 a month straight to Open AI vs hiring a junior SWE

Re:OpenAI Needs $400B In The Next 12 Months by Beijinger on Friday October 17, 2025 @03:44PM (#45621164)
Yes. But there is not only OpenAI. There is Gemini, Grok, whatever. If it doesn't become a "the winner takes it all" but a commodity like web hosting, then the payoff breaks down.
Re:OpenAI Needs $400B In The Next 12 Months by thijson on Friday October 17, 2025 @03:45PM (#45621183)
I feel like options for local inference are getting better. AMD has their Strix Halo. Intel's next CPU generation Arrow Lake will have better inference abilities as well.
Re:OpenAI Needs $400B In The Next 12 Months by paulcole on Friday October 17, 2025 @04:00PM (#45621319)
How clearly are you able to define “actual work” and “toying around?”

Or is this the case of every HN discussion where what you do is “actual work” and what other people do is “toying around?”

Re:OpenAI Needs $400B In The Next 12 Months by moomoo11 on Friday October 17, 2025 @05:35PM (#45622372)
Are you making [actual] money? That's literally it.
Re:OpenAI Needs $400B In The Next 12 Months by paulcole on Friday October 17, 2025 @06:27PM (#45622876)
I don’t know why you’re downvoted. It’s a good and fair answer. I disagree with it to some extent but at least it makes sense.
Re:OpenAI Needs $400B In The Next 12 Months by moomoo11 on Friday October 17, 2025 @06:41PM (#45622987)
No worries. I stopped caring about points and validation years ago lol just being honest is enough for me.
Re:OpenAI Needs $400B In The Next 12 Months by georgemcbay on Friday October 17, 2025 @03:41PM (#45621133)
> For actual work and not toying around the 10% gap is absolutely worth the cost.

I agree with this... for now. But the hosted commercial models aren't widening the gap as far as I can tell, if anything it appears to be narrowing.

And if the relative delta doesn't increase somehow I don't see any way in which the "AI race" doesn't end in a situation where locally run LLMs on relatively cheap hardware end up being good enough for virtually everyone.

Which in many ways is the best possible outcome, except for the likely severe economic effects when the bubble bursts on the commercial AI side.

Re:OpenAI Needs $400B In The Next 12 Months by moomoo11 on Friday October 17, 2025 @05:35PM (#45622378)
Sure. I'm talking about now.

I don't know what will happen tomorrow, let alone 1 year or more down the line.

If it ever becomes economical to run and maintain bare metal GPU compute to run LLMs, then that's what will need to be done..

Re:OpenAI Needs $400B In The Next 12 Months by samastur on Friday October 17, 2025 @04:29PM (#45621667)
This highly depends on the price difference and value you get form those 10%.
Re:OpenAI Needs $400B In The Next 12 Months by tkz1312 on Friday October 17, 2025 @04:54PM (#45621942)
Don’t underestimate the cost of getting locked into a tool that is 100% guaranteed to rugpull you on both cost and privacy.
Re:OpenAI Needs $400B In The Next 12 Months by moomoo11 on Friday October 17, 2025 @05:33PM (#45622354)
You know that this is literally not a concern right? It is part of business life to navigate such a situation.

When I was a SWE, I've done migrations between bare metal to AWS to GCP and then both, and then all plus Azure..

It is the cost of doing business. You pick what works best at a price that is optimized for your business needs now. You have a war chest so when they start becoming assholes, you have leverage to fight back or pivot.

I'd rather spend $200-400/mo to unblock myself NOW than do something dumb with 5 or even 100 tokens per second output that isn't actually that good as what the current providers offer. I'm going through millions of tokens a day.. I couldn't do that with local "RIGHT NOW" (<--- important)