News for hackers. Stuff that matters.
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @03:05PM (#50397661)
> The people saying that local models can easily replace the real Frontier Models from Anthropic or OpenAI are just not using it for the same things you and I do.

> They seem to be happy with their small usages.

Oh yes, we're terribly inferior people. Just living on scraps from the table.

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by yh11 on Friday November 06, 2026 @03:53PM (#50398377)
anyone who is working on an remotely difficult codebase will notice a huge difference, either you are an incompetent dev or dont code at all
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @04:47PM (#50398952)
Ahh yes. Those are the only two options.
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dennysora-main on Friday November 06, 2026 @05:21PM (#50399285)
I really strongly agree with this statement. A bunch of people aren't even engineers, and their abilities aren't that good either, yet they keep saying that open-source models can replace OpenAI or Anthropic's models.

If that were really the case, basically nobody would spend so much money using them.

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @05:27PM (#50399337)
Putting aside that you're "really strongly" agreeing with a personally directed insult:

You should factor in that undeniably most people don't have the means to run even a 27B dense model locally, and therefore do not actually know what they are and are not capable of.

And you might want to look at openrouter's rankings.

If you are comfortable assuming that "doesn't use Claude or Codex" is equivalent to "not a good engineer" or "bad engineer", then I think you are probably lost to more nuanced discussions.

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by origini on Friday November 06, 2026 @05:45PM (#50399510)
I try local models regularly on 2x 4090 and struggle with context length constantly. 48GB on GPU and 128GB from RAM.

the original comment mentioned only 16GB of VRAM.

You know talk about Open Router and 27B dense model?

We are not comparing an even more expensive Hardwaresetup to run local models with proper context window and parameters.

Can i run some open model on a super expensive Mac Book or co with some kind of okayisch results? Yeah sure but you know what the t/s will be and yeah Frontier is still Frontier and Kimi, GLM, DeepSeek are not Frontier. They lag half a year.

You are not getting Opus 5 or Sonnet at home for now.

Why are you so offended by this?

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @07:49PM (#50400521)
I'm not offended. I'm also not the person resorting to insults.
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dennysora-main on Friday November 06, 2026 @07:25PM (#50400366)
With my DGX Spark + 5080 + 3060 setup, I've tried all kinds of approaches, including quantization, acceleration, fine-tuning, post-training, and everything else.

It still can't compare to Opus 5.5 max in terms of speed, capability, and stability.

And when I calculate all the money I've invested, directly subscribing to the service would actually be cheaper, more efficient, and more stable.

Open source is great, but don't glorify it.

The architecture of the code I develop has never been simple. If you're someone who doesn't even work on things that need to be deployed to something like k8s, then basically, open-source models are indeed enough for you.

Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by dofm on Friday November 06, 2026 @10:33PM (#50401387)
You can sell your DGX Spark for basically no loss. Maybe even make money.
Re:Anthropic IPO Buyers See Valuation as Low as $1.1T by origini on Friday November 06, 2026 @03:56PM (#50398404)
It wasn't meant as a dismissive comment.

I do plenty of experiments of things i always wanted to do and they just don't work with local models.

Finetuning of some ML models for a specific usecase, some 4k demo idea i had, small browser games to show others game mechanic ideas i had for ages, analysis tools etc.

Even just playing around with some Ghidra eats context like nothing.