News for hackers. Stuff that matters.

A comment on Anthropic IPO. Parent comment

Re:Anthropic IPO by maxdo on Thursday November 12, 2026 @11:33AM (#50470055)
local models are economical pipe dream. Before open router, you have to buy GPU commitment for any large usage. essentially doing that 24 hours every day in a year.

Why on earth anyone would use local model, and absorb all the costs, if you can just pay $20-$100/mo and not deal with any hustle? Unless you are developer, or someone who use it extensively, but in this case, local model is not enough for you.

If your use case is trivial you pay extra price for hardware while using mediocre quality. If your use case is intensive , e.g software, science, medicine, legal, etc, you want cutting edge. You getting it for free, immediately.

[ Parent | on HN ]
Re:Anthropic IPO by stackskipton on Thursday November 12, 2026 @11:47AM (#50470272)
Sure, but as "local" models improve, I've heard of more and more companies deciding to bring it in house. As hardware prices possibly get more attractive, that will make more and more sense for many companies. Enterprise don't mind paying flat rate for SaaS but variable billing model gives a ton of business people pause.

I'm an SRE and I just wrote some terraform to deploy G4DN instances for local evaluation for mid-size company.

[ Parent | on HN ]