News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @12:58PM (#48981500)
Honestly, whether you think burning current SOTA to hardware is an overinvestment risk depends on what your definition of intelligence is. If you think intelligence is something that can grow like height such that 18 months from now we will basically be bowing down to machine god giants that are running on B200s, then investing in ASICs is the wrong move. However, if you you subscribe to the (very reasonable view) that intelligence is more like a round ball that we are trying to make as spherical as possible (ala Francois Chollet's writings), then at some point the ball will be smooth enough for most people and many tasks.

It takes about 18 months to go through the design, verification, and manufacturing process if you move at breakneck pace. Design could probably be sped up.

About 18 months ago the top model was GPT-4o. Not great by today's standards, but still good enough for many tasks (certainly a big chunk of chatbot queries). The current SOTA covers far more use cases, but importantly at a level that surpasses many thresholds of utility.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @02:29PM (#48982898)
I think part of this thinking is in reverse. What I mean by that is people are saying something like "Imagine if 18 months ago a company started to create an ASIC based on GPT-4o (or whatever was good at the time). By today they'd have a model that is not great by today's standard but good enough".

Maybe, but what is the shelf-life of that 18 month decision? Barely good enough today, when it launches, starts to get worse and worse every month going forward. You have to recuperate that investment on your depreciating asset.

And you are competing against anyone with the foresight to use a TPU instead, and the benefit from any new paper that finds how to distill, quantize or whatever better so their solution gets algorithmic boosts while you are locked in.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JohnBooty on Monday July 20, 2026 @01:28PM (#48981966)
At a 50-100x speedup even a GPT-4o class model could perhaps compete with much newer models simply by thinking deeper, doing harness-controlled Ralph loops, etc. Sure, then it might be "only" ~2-5x faster, but, you wouldn't need to throw all the ASICs into the trash bin.

One could also imagine hybrid models, where part of the model is burned into ASICs and part of the model exists in VRAM/HBM2 so it can be updated.

I don't have enough low-level knowledge to evaluate the technical or economic feasibility of the above ideas, however.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @03:24PM (#48983661)
Giving a literal monkey the ability to press more keys faster doesn't get a good joke from it.

An inferior model will often come up with worse results given more cycles of compute, only because it will tailspin from second guesses, rethinking and literal flip-flopping on concepts.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:30PM (#48983738)
Said the OAI/Anthropic stockholder
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @03:33PM (#48983783)
LOL.. neither... but good luck on your standup career with jokes by literal monkeys.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:46PM (#48983940)
I hate to break it to you but firms dont care what a better model is.

They care what is best for the financials.

If china is good enough? Guess what? They will use it. Go cry in the corner bro.

Infact anthropic has done such a good job at burning trust, people are cheering on the chinese LOL

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @04:00PM (#48984123)
Are you being paid by China? First you accuse me of simply speaking as a financial benefactor, then you totally shift the conversation into something that doesn't refute what I said.

If you let a model spin too much, you get worse results... that's a fact, even for the best models. Nothing you've stated since actually refutes that and acting like a paid bot doesn't mean anything.

I mean, if you want to felate Xi Jinping, have at it... that's all on you bro. I don't have a horse in this race.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @04:06PM (#48984202)
You sound like the same bozo that said china cant compete because of a lack of funds.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @04:26PM (#48984426)
Never said any such thing... China is willing to abuse anyone and everyone including its own people to get ahead in global markets and to leverage any position of dominance possible. They have an absolute history of competition as a fascist economy. I have never, not once, denied such a reality.

You're just an idiot who assumes everyone that doesn't agree with you is the same. I'm surprised you're able to reply with Xi's penis in your mouth... even if it is kind of spacious in there for his limited size. How is the poo bear these days? Does he like it when you gargle his testicles in your mouth?

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JohnBooty on Wednesday July 22, 2026 @06:41PM (#49014465)

    Giving a literal monkey the ability to press more 
    keys faster doesn't get a good joke from it.
To some extent, it's because making a joke isn't an iterative exercise with a verifiably correct outcome.

However, a lot of jobs are. Notably, much of software engineering.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by boplicity on Monday July 20, 2026 @04:27PM (#48984443)
For many, many tasks, you only need good enough results that accomplish a clearly-defined set of criteria. Smaller models that run 50x faster, in this case, could be far superior to a much slower model that meets the same criteria.

Sometimes you need speed; sometimes you need quality. There are very different use cases for each. For my own workflows, I sometimes want something very simple done ASAP; other workflows need "subjective" reasoning and careful crafting of responses.