News for hackers. Stuff that matters.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @12:13PM (#48980866)
The open weight, open architecture releases of the past several days has me more convinced that ultimately, the winner will be whoever burns their models to ASICs fastest.

The LLMs themselves are capable of doing some aspects of chip design as evinced by the K3 press release.

Furthermore, the frontier models are "good enough" for a wide swathe of tasks and will soon hit that threshold for a good amount of software engineering (if not already). Does anyone think we need a Mythos level model to plan a road trip, or give someone tips on making a cake recipe?

A Fable 5 model running at 9,000 tokens/s on an ASIC rather than 150 tokens/s on electricity chugging Nvidia GPUs, or even giant SRAM Cerebras or Groq chips could be good enough to meet the majority of demand.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by misiti3780 on Monday July 20, 2026 @12:16PM (#48980920)
is anyone doing this ?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @12:20PM (#48980974)
The closest example I've seen is ChatJimmy: https://chatjimmy.ai/ a prototype from Taalas running Llama 8B

Scaling this up to 2.8 Trillion (350X increase), will certainly be challenging.

If I was younger and had the right background, I'd love to dive into attempting somethign like this

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by selectodude on Monday July 20, 2026 @01:41PM (#48982126)
Also a 3-bit quant. Useable but a long long way away from useful.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by gopalv on Monday July 20, 2026 @12:44PM (#48981330)
Taalas HC1 is the closest thing to this.

Last I saw they posted Deepseek R1 numbers in Feb of this year.

The challenge is rolling out a new one every 7-8 weeks as the weights change & cheap enough for a hyper scaler to afford to buy one and save enough on power over the next 8 weeks as a payoff.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by 535188B17C93743 on Monday July 20, 2026 @12:51PM (#48981415)
Yeah, I've heard of Taalas doing it. Not sure of others but I'm sure lots of companies are considering it, especially as we start to hit points of depreciating returns in training.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by carterschonwald on Monday July 20, 2026 @12:20PM (#48980976)
not sure about that, but im actively working on designing ultra sparse models that i want to have perform competitively with stuff 100-10_000 times larger. ehich does yield similar throughput. time will tell id it works out
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by eckr on Monday July 20, 2026 @12:20PM (#48980978)
There was a startup that did this for Llama 3, I forgot their name. Etched is also doing some similar things I believe.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by robgough on Monday July 20, 2026 @12:22PM (#48981002)
obligatory link to https://chatjimmy.ai
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hnfong on Monday July 20, 2026 @12:35PM (#48981199)
It sounds vaguely similar to what Cerebras.ai is doing
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alach11 on Monday July 20, 2026 @07:50PM (#48986382)
News just broke today that Google is planning on doing this: https://news.ycombinator.com/item?id=48986351
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @12:23PM (#48981023)
I'm not convinced, mostly because things like crypto, which I believe went into ASICs, were based on very slowly moving and mostly understood algorithms. LLMs and model architectures seems significantly more volatile. I wouldn't want to be working out the finer details of my chip rollout only to find a new paper/approach that give multiples of performance.

So I guess it depends on how much the latest-greatest model motivates people, and my read on the current churn is that developers are extremely unloyal to brand at this point and will jump to whoever has the best model. And as long as the best model is running on programmable GPUs, that will be the dominant form.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by akiselev on Monday July 20, 2026 @12:48PM (#48981379)
The tokens per second performance numbers coming from Cerebrus/Talas are several orders of magnitude higher than models running on GPUs, which is such a huge step change that it will enable many more uses of LLMs that are impractical otherwise. I.e. think about gamers and burning in an LLM chip on a game console like a future Play Station - it doesn't matter if its a frontier LLM if it allows them to talk to in game characters in real time and have the LLM drive the storyline. The devs may be limited to training/RLHFing legacy models, but the performance enables many more use cases.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @01:30PM (#48981995)
I admit I would like a faster model - but even though I have faster models available I still go to Fable or GPT-5.6 90% of the time. So there is a gap between a potential preference and a revealed preference.

Custom AI for things like facial recognition in cameras has existed for decades, before LLMs were a thing. I don't see that getting replaced. And on-device conversational intelligence might go that route as well, we'll have to wait and see. It's a lot of silicon to dedicated to a static non-changing thing. My money would be on programmable TPU-like things (Apple's NPU kind of stuff). It just seems more flexible to have an array of compute that you can load different models into, so you can update it, etc.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:26PM (#48983699)
What you think doesn't matter unless its strictly for personal use.

Your company will decide what makes economical sense.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by dehugger on Thursday July 23, 2026 @05:42PM (#49028440)
Some of us happen to be in positions to make those decisions at our respective companies. What we think does, in fact, matter.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by breuleux on Monday July 20, 2026 @08:07PM (#48986539)
> even though I have faster models available I still go to Fable or GPT-5.6 90% of the time

What about all the things you don't currently use an LLM for?

If a specialized chip can run a model 100 times faster, you can suddenly use it for a lot of things at sub-second latency. You can write "make white transparent and add a red outline to x.png" instead of the corresponding imagemagick invocation and perceive little to no latency difference. You can hook it up to your browser and have it yank out all advertisements live, or tell it to highlight anything that might interest you, again, live. There's probably thousands of latent use cases nobody has thought of that would be enabled by a truly fast LLM, even a mediocre one.

I don't think an on-device model needs to change much; it's already quite general in its capabilities.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by prirun on Monday July 20, 2026 @08:46PM (#48986804)
> hook it up to your browser and have it yank out all advertisements live

AI: "I'm sorry, a security guardrail prevents me from performing this operation."

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by itemize123 on Tuesday July 21, 2026 @04:54AM (#48989760)
or, hear me out, advertisers can do real-time advertising based on hyper-now context
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by breuleux on Tuesday July 21, 2026 @04:02PM (#48997455)
Yeah... savage capitalism will ruin this too :'(
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by invalidusernam3 on Tuesday July 21, 2026 @06:02AM (#48990204)
Exactly, I think a lot of people aren't thinking about it this way, they're imagining a faster version of ChatGPT. In reality if it was a frontier model running a these speeds it would change so much about how we interact with computers. It would be custom hyper specific software on demand.

Looking for a lamp in a specific style?

"Make a VR application set inside my apartment (based on all the photos of my apartment from my photos directory) with all lamps under $100 that fit Scandinavian interiors and could be delivered to my house before Friday. Place the lamp on the dining room table, allow us to: cycle through lamps, change time of day, and interact with all the lamps and furniture".

Five seconds later and bam you have this new piece of software that you'll use once and then dispose of.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by super256 on Tuesday July 21, 2026 @09:05AM (#48991820)
You will be very happy once OpenAI serves GPT-5.6-Sol on Cerebus at 750 token/s.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:09PM (#48981642)
> Cerebrus/Talas

They are fast, but they're still programmable accelerators, not a model burned into the gates.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by neynt on Monday July 20, 2026 @01:13PM (#48981706)
Cerebras is a programmable accelerator, but Taalas does burn the model into the gates.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:15PM (#48981739)
Ah, right. I misremembered. Does Taalas have a meaningful advantage here then?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by lsaferite on Monday July 20, 2026 @01:45PM (#48982179)
Taalas claims significant cost, speed, and power differential with running on Nvidia (and similar) hardware. Their whole thesis is that with making the hardware cost less, run faster, and run with less power mixed with their claimed fast production cycle for new weights, companies would plan on purchasing and then relegating the other chips to different workloads at the next update cycle. And the chips have facilities for fine-tunes that can by dynamically loaded. The info I've seen has been very light on details, but if they can even get halfway where they are planning, it'll be a massive shift.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by wyre on Monday July 20, 2026 @01:31PM (#48982005)
6x. Taalas has Llama3.1 8B running at 18000 tok/s. Cerebras advertised that model at 3000 tok/s.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:35PM (#48982053)
Interesting. Is the speedup from specializing for the shape of Llama 3.1 or are they (contra my mental model) actually winning on burning in the weights?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by akiselev on Monday July 20, 2026 @01:59PM (#48982397)
The weights are in SRAM, so the LLM architecture is burned in but the weights can be updated.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hedgehog on Monday July 20, 2026 @03:10PM (#48983485)
No the weights are in the metal layers, they cannot be updated.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by jfim on Monday July 20, 2026 @07:15PM (#48986092)
The base weights can't be updated but from what I recall it allows adding a low rank adapter to customize the model a little bit.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hedgehog on Tuesday July 21, 2026 @10:42AM (#48992971)
Yes that's what I've read. As far as I know the approach should transfer well to hybrid model architectures like modern Qwen and sizes like 27B by using multiple chips. LoRA-steered Qwen 27B at 10K+ tokens per second would be transformative for some workflows.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by Tuna-Fish on Monday July 20, 2026 @05:55PM (#48985376)
Taalas only uses SRAM for the KV cache and the activations, the weights are in mask rom in the metal layers.

If they designed this right, it means that once they have a model, so long as they keep the hyperparameters fixed they can change the weights much faster than it takes to spin up a completely new chip, essentially at a cost of doing a minor revision.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @07:04PM (#48985981)
Is the mask ROM really going to be worth it over Carmack's high-bandwidth-flash concept? I mean, sure, I could be convinced I guess, but it's not obvious.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by Tuna-Fish on Tuesday July 21, 2026 @04:42PM (#48998002)
Yes.

Not because rom is better than flash, but because the critical part is distributing the memory with the compute. Mask ROM is just the densest way of embedding memory with logic. Instead of having a large pool of memory connected to the separate execution units with a bus, each execution unit locally has the rom that it uses. Data movement is >90% of energy use in modern ai accelerators, removing it as far as practical is how they get performance and silicon and energy efficiency.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tacitusarc on Tuesday July 21, 2026 @10:02PM (#49000937)
But attention/KV cache is the heavy bit in long context lengths which is what everyone needs…
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by HNisCIS on Monday July 20, 2026 @01:49PM (#48982228)
8B is still three orders smaller than current frontier though
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by brian-armstrong on Monday July 20, 2026 @05:54PM (#48985360)
The models would have to get significantly better for this to help, though. Unedited LLM dialog is quite bad. Though, I wouldn't put it past AAAs to try anyway.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by F7F7F7 on Monday July 20, 2026 @06:48PM (#48985854)
This is where treating these smaller models more like parts in a purpose built appliance ultimately benefits us.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by aurareturn on Monday July 20, 2026 @07:26PM (#48986191)
I don't think ASICs is the long term answer here at the local LLM level. I think GPUs will still be.

If you can have only one AI processor in your laptop (because they're big and expensive), it's going to be a GPU. This AI processor needs to inference LLMs, audio processing, image generation, video generation, etc. This is on top of normal graphics processing requirements such as video games, playing videos, decoding, encoding, etc.

At the enterprise level, I can see some ASICs working once the market fully matures and improvements in architectures slow down drastically while demand for inference increases drastically. How far are we from this world? Maybe 5-10 years? It seems like model architectures are still changing rapidly and labs want fast experimentation that programmable GPUs offer.

GPUs will still dominate in general - just like how CPUs still dominate despite ASICs.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @12:58PM (#48981500)
Honestly, whether you think burning current SOTA to hardware is an overinvestment risk depends on what your definition of intelligence is. If you think intelligence is something that can grow like height such that 18 months from now we will basically be bowing down to machine god giants that are running on B200s, then investing in ASICs is the wrong move. However, if you you subscribe to the (very reasonable view) that intelligence is more like a round ball that we are trying to make as spherical as possible (ala Francois Chollet's writings), then at some point the ball will be smooth enough for most people and many tasks.

It takes about 18 months to go through the design, verification, and manufacturing process if you move at breakneck pace. Design could probably be sped up.

About 18 months ago the top model was GPT-4o. Not great by today's standards, but still good enough for many tasks (certainly a big chunk of chatbot queries). The current SOTA covers far more use cases, but importantly at a level that surpasses many thresholds of utility.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @02:29PM (#48982898)
I think part of this thinking is in reverse. What I mean by that is people are saying something like "Imagine if 18 months ago a company started to create an ASIC based on GPT-4o (or whatever was good at the time). By today they'd have a model that is not great by today's standard but good enough".

Maybe, but what is the shelf-life of that 18 month decision? Barely good enough today, when it launches, starts to get worse and worse every month going forward. You have to recuperate that investment on your depreciating asset.

And you are competing against anyone with the foresight to use a TPU instead, and the benefit from any new paper that finds how to distill, quantize or whatever better so their solution gets algorithmic boosts while you are locked in.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JohnBooty on Monday July 20, 2026 @01:28PM (#48981966)
At a 50-100x speedup even a GPT-4o class model could perhaps compete with much newer models simply by thinking deeper, doing harness-controlled Ralph loops, etc. Sure, then it might be "only" ~2-5x faster, but, you wouldn't need to throw all the ASICs into the trash bin.

One could also imagine hybrid models, where part of the model is burned into ASICs and part of the model exists in VRAM/HBM2 so it can be updated.

I don't have enough low-level knowledge to evaluate the technical or economic feasibility of the above ideas, however.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @03:24PM (#48983661)
Giving a literal monkey the ability to press more keys faster doesn't get a good joke from it.

An inferior model will often come up with worse results given more cycles of compute, only because it will tailspin from second guesses, rethinking and literal flip-flopping on concepts.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:30PM (#48983738)
Said the OAI/Anthropic stockholder
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @03:33PM (#48983783)
LOL.. neither... but good luck on your standup career with jokes by literal monkeys.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:46PM (#48983940)
I hate to break it to you but firms dont care what a better model is.

They care what is best for the financials.

If china is good enough? Guess what? They will use it. Go cry in the corner bro.

Infact anthropic has done such a good job at burning trust, people are cheering on the chinese LOL

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @04:00PM (#48984123)
Are you being paid by China? First you accuse me of simply speaking as a financial benefactor, then you totally shift the conversation into something that doesn't refute what I said.

If you let a model spin too much, you get worse results... that's a fact, even for the best models. Nothing you've stated since actually refutes that and acting like a paid bot doesn't mean anything.

I mean, if you want to felate Xi Jinping, have at it... that's all on you bro. I don't have a horse in this race.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @04:06PM (#48984202)
You sound like the same bozo that said china cant compete because of a lack of funds.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @04:26PM (#48984426)
Never said any such thing... China is willing to abuse anyone and everyone including its own people to get ahead in global markets and to leverage any position of dominance possible. They have an absolute history of competition as a fascist economy. I have never, not once, denied such a reality.

You're just an idiot who assumes everyone that doesn't agree with you is the same. I'm surprised you're able to reply with Xi's penis in your mouth... even if it is kind of spacious in there for his limited size. How is the poo bear these days? Does he like it when you gargle his testicles in your mouth?

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JohnBooty on Wednesday July 22, 2026 @06:41PM (#49014465)

    Giving a literal monkey the ability to press more 
    keys faster doesn't get a good joke from it.
To some extent, it's because making a joke isn't an iterative exercise with a verifiably correct outcome.

However, a lot of jobs are. Notably, much of software engineering.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by boplicity on Monday July 20, 2026 @04:27PM (#48984443)
For many, many tasks, you only need good enough results that accomplish a clearly-defined set of criteria. Smaller models that run 50x faster, in this case, could be far superior to a much slower model that meets the same criteria.

Sometimes you need speed; sometimes you need quality. There are very different use cases for each. For my own workflows, I sometimes want something very simple done ASAP; other workflows need "subjective" reasoning and careful crafting of responses.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by drob518 on Monday July 20, 2026 @02:16PM (#48982683)
The churn is an issue. For a while there, it felt like we were getting a new number format every month or two (e.g., fp4, ternary, etc.). That level of innovation works against moving things into hardware, or at least you need to be willing to spin hardware constantly.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @05:34PM (#48985176)
Even then... Do we now stop the with to asic DeepSeek and do k3 instead?

Assuming such work was happening.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by drob518 on Monday July 20, 2026 @09:05PM (#48986908)
My personal feeling is to not move to ASICs just yet. Things are still pretty frothy right now, so I would probably wait 6-12 months. At some point the froth always calms down. At that point, commit to ASICs. That said, I’m also not totally sure exactly how much the ASIC hard codes vs having some wiggle room. The Taalas site is a bit vague as to exactly how they encode the model.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Tuesday July 21, 2026 @06:17PM (#48999128)
I would probably wait until a year goes by without any significant advancement, at the very least before making such an effort.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alex43578 on Monday July 20, 2026 @12:36PM (#48981202)
I think the gamble comes down to how many tokens need to be served on your best model, versus how many can be served in the cheapest/fastest way.

Imagine if Anthropic could give effectively unlimited access to Sonnet, for $20. Wouldn’t that be an appealing option for many users? I know I’d make a lot of use of it for agentic tasks, office work, summarization, etc; when right now I’d save quota for more important tasks.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @01:19PM (#48981801)
I mean, if I imagine Anthropic giving away unlimited Sonnet 4.5 away at $20, I would still be paying the $200 for fable.

It is a bit like saying "why would you hire someone with a doctorate when you could get unlimited high school grads". How appealing that sounds depends on your needs.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by margalabargala on Monday July 20, 2026 @01:31PM (#48981999)
Right, and while there are needs that require a doctorate, having unlimited high school grads would be immensely useful for many many tasks.

The ability levels of the cheap models are encroaching on the abilities of the frontier models faster than frontier models are expanding their abilities. If we haven't already, we will very soon reach a "good enough" state where having the "best" model matters less and less and less.

By analogy, if you buy a new computer, do you get the absolute fastest CPU available? Maybe, depending on your workload. But if you're 90% of the population, you get the cheapest one that has enough power to meet your expected workload, which is mid-range, not top of the line.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @02:17PM (#48982710)
I think there is growing confusion in this discussion. I am saying "I see the fixed nature of ASICs creating a barrier to their adoption despite how cheap they are".

Many of the responses seem to say "but there is a market for cheap models".

There is a world where we have cheap models and we don't have ASICs powering them. Things like TPUs and NPUs, which are programmable, are likely to fill that role. They are optimized for inference while also allowing different (and updated) models to run on them.

Given two companies competing on the cheap end. First company goes TPU, second goes ASIC: who wins? My bet is on TPU since they can update their model, even if their hardware is slightly more expensive and slightly slower, since the optionality of new models beats the performance gap. That may not hold forever but given the pace and volatility of the current LLM market, I believe it will hold for some time.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by margalabargala on Monday July 20, 2026 @02:28PM (#48982869)
The reason you are getting "but there is a market for cheap models" as a response, is people saying in a roundabout way "but soon models may not need to be updated".

Models like Kimi 3, GLM 5.2, or even Fable 5 for that matter are reasonable to burn to.ASIC because they are over the threshold of "good enough to be generally useful", something that will continue to be true in the future.

Most people do not need the latest model, they need a sufficient model. If I had Fable 5 on an ASIC, I imagine I would use that and ignore paying API rates for Fable 6.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @02:37PM (#48983012)
> but soon models may not need to be updated

Which is why my original post mentioned the volatility in models. We aren't just doing research on frontier, there is a huge amount of research on quantization, distillation, etc. that is changing the landscape at the low-end almost as much as it is changing on the frontier.

And it is also why I mention revealed preference. What feels sufficient / "good enough" today is a moving target. This isn't just a question of what you want, it is a question of what is economically viable for the entity that will be designing, manufacturing and marketing this ASIC of which you speak.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by margalabargala on Monday July 20, 2026 @02:57PM (#48983290)
That moving target is different for everyone and their use case, and for me, it's already passed. I remember using Opus 4.5 and thinking "this is good enough to do everything I want it to do properly" and I stand by that. Paying $10k for unlimited Opus 4.5 running at 9k tok/s would IMO allow me to do more, faster, than putting the same money into $200/mo anthropic subscriptions for the latest and greatest.

This is me personally. The calculus is different for other people. But I suspect Kimi 3 is pretty darn close to that tipping point for an awful lot of people.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by daadx on Monday July 20, 2026 @07:46PM (#48986356)
Unless he's talking about personal use then he's a bozo - he won't get to decide.

The managers of the firm will.

They dont care that its faster unless it translates into the financials. They want lower costs, higher revenues - explain how it fits brudda.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tracker1 on Monday July 20, 2026 @03:27PM (#48983704)
How much compute does the cheap model require to operate? Power + hardware amortized over a couple years.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alex43578 on Monday July 20, 2026 @01:28PM (#48981959)
It’s like how most people on here would want a loaded MacBook Pro or RTX 5090, but chromebooks and iGPUs do volume.

There’s absolutely a place for a lifestyle subscription to a sonnet model that you could just use everywhere all the time.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stillpointlab on Monday July 20, 2026 @01:34PM (#48982048)
Yes, but the context of the discussion is "who wins the war and how". And you are moving the goal posts very far from the original claim, which is that the speed with which companies can get their models onto ASICs will be the determining factor.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by drob518 on Monday July 20, 2026 @02:20PM (#48982745)
Sure, but you’re undoubtedly the tip of the spear. Lots of people don’t need that.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by vel0city on Monday July 20, 2026 @02:44PM (#48983122)
What percentage of white collar work these days requires doctorate level thinking all the time?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by gavin_gee on Monday July 20, 2026 @12:32PM (#48981152)
seems to me that we are at the asymtote for most usage. sure run the prompts that need the frontier on generic silicon but burning the fable 5 model into silicon could be perfectly viable
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by freeopinion on Monday July 20, 2026 @06:40PM (#48985774)
I thought about the volatility, too. But here are some additional thoughts:

Many AI uses are not that volatile. I had a 20 minute conversation today with some company's AI phone assistant. It was extremely good and would have been very helpful if any of the dozen people it tried to route me to would have picked up their phone. That AI won't need to be upgraded for a very long time. There is no reason for it to have a cloud brain except to force a recurring revenue for the company selling it.

Hardcore gamers are constantly throwing down insane money on the latest hardware. The rest of us can get by for a couple years with whatever we bought when the last one broke. Yeah, it's not the latest, but it gets the job done. I wonder if AI has not already reached the point where a gen 10 CPU--uh, I mean a v3 AI model--will get the job done for the next year. If I really need the up-to-the-second latest abilities for a minute, I can fallback to a cloud brain @ 1M tokens/$. Why pay a monthly lease on a 5-year plan for a 4-door Ford Ranger as your daily commuter? Buy a Clio and rent an F-250 twice a year when you need the hauling/towing capabilities.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by teleforce on Monday July 20, 2026 @07:56PM (#48986427)
>I'm not convinced, mostly because things like crypto, which I believe went into ASICs, were based on very slowly moving and mostly understood algorithms.

Yesterday there's a news on a breakthrough for probabilistic computer (UxHw) with 1 million p-bits [1].

Since LLM is stochastic in nature, this type of new computer can be much better than ASIC for processing LLM data.

[1] Biggest Probabilistic Computer Turns Noise into Answers:

https://news.ycombinator.com/item?id=48971938

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by nightski on Monday July 20, 2026 @07:59PM (#48986457)
Except LLMs are not stochastic in nature. Correct me if I am wrong, but it's just the final layer which outputs a distribution across the output tokens. In reality, the rest of the model is deterministic.

This is not like a bayes model or something were it's distributions all the way down.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by gigatexal on Monday July 20, 2026 @10:01PM (#48987203)
Apparently Google and team will build ASICs to run Gemini even though they have TPUs and it’ll be somewhat dynamic since the weights can be made modular [1]

[1] https://finance.yahoo.com/technology/ai/articles/google-plan...

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alhirzel on Tuesday July 21, 2026 @10:24AM (#48992768)
I think it depends on how good is "good enough". Personally, I think as long as tasks are not coding, there would be a ton of "good enough" value in having your own personal Google on a hardware device. I think the company that designs and licenses the architecture that packages the silicon for the largest market share will be the winner in commercializing this product. Wouldn't be surprised if this is part of Apple's roadmap to retaining existing customer loyalty.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by umeshunni on Monday July 20, 2026 @12:27PM (#48981085)
> the winner will be whoever burns their models to ASICs fastest.

I don't understand how this works when the models are evolving so fast that your burned ASIC is outdated (or at least not top of the line) in a few weeks.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by tempoponet on Monday July 20, 2026 @12:37PM (#48981222)
If llama 3 70b were available for $400 today, people would make it work. They would have 4 of them working side by side or 1 of them working with a GPU on another model.

To me, it's like imagining if Sonnet 3 was burned into an ASIC 8 years ago and then never changed. It would still be revolutionary, and today we would have an entire ecosystem of tools and services built around it, likely surpassing some of our current workflows.

The frontier is a different beast, but it would likely mean competing on price.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by treis on Monday July 20, 2026 @03:05PM (#48983417)
I think you'd be better off getting 1% of a $40,000 card. Or maybe 10% of a $4,000 card is more realistic.

I think that's the problem at the moment. A much better LLM that doesn't use my battery is 20ms and <10mb of data away.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by efficax on Monday July 20, 2026 @01:48PM (#48982224)
for many purposes they're good enough now. If I had an opus 4.8 class model on a box next to me that could produce tokens at rates like 5000/s, i don't know if i'd need a new one for a long time. I think we might be underestimating how powerful very very fast LLMs could be, since they could iterate on tons of small variations on tasks. paired with deterministic guardrails that gate "doneness", you could loop on tasks for a long time having the agent try different strategies until the goal was reached, in ways that are just impractical now (and very expensive)
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by drob518 on Monday July 20, 2026 @02:33PM (#48982955)
Exactly. A fast, cheap model, particularly with the right harness and loops, might take us a lot farther than we might guess.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by bensyverson on Monday July 20, 2026 @12:46PM (#48981355)
I think it makes more sense if you think about an ASIC pipeline which is updated on an annual basis, like Apple's M or A-series chips.

Sure, an ASIC model will always be behind (12 months? 18 months?), and a hosted flagship will be significantly better. But as time marches on, would I use a flagship model from last year if it came on a PCI card and cost $1000? Without a shadow of a doubt.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by mountainriver on Monday July 20, 2026 @12:34PM (#48981174)
Sol is running on Cerebras right?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @01:02PM (#48981546)
Cerebras is not an ASIC. It is a large wafer scale chip that has a load of small SRAM modules paired with tiny compute models. The SRAM is basically a giant cache that is supposed to eliminate the bottleneck between shuttling and materializing big tensors between DRAM and cache, but the actual amount of SRAM is still nowhere near enough to server a frontier model on a single wafer. You still need dozens of wafers, which makes Cerebras rather cost intensive given that Nvidia can get dozens of GPUs out of a single wafer
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by mountainriver on Wednesday July 22, 2026 @10:33AM (#49007504)
I know that but they also said Cerebras
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by gopalv on Monday July 20, 2026 @12:34PM (#48981176)
> Does anyone think we need a Mythos level model to plan a road trip, or give someone tips on making a cake recipe?

This is starting to look at a lot like Intel vs Arm from the last era.

The Fable & Mythos are starting to look like a giant Xeon, while the smaller lighter models are starting to look like a lot of tiny ARM chips which sip on power instead.

The risk is the same as what Intel had. There is a group who are pushing them to go bigger and with a resource no limit approach, who have a lot of dollars to push you that way.

Follow them and they lead you to a pile of money, but then you risk something like Apple Silicon happening.

Something which got better because of efficiency & continuous improvement, not neutered due to it.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by lend000 on Monday July 20, 2026 @12:49PM (#48981393)
> The risk is the same as what Intel had. There is a group who are pushing them to go bigger and with a resource no limit approach, who have a lot of dollars to push you that way. Follow them and they lead you to a pile of money, but then you risk something like Apple Silicon happening.

The problem was that Intel stopped making things faster and better, and shifted to wearables and mobile chips instead of investing in their hard-tech strategy that had worked for decades.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alex43578 on Monday July 20, 2026 @12:38PM (#48981234)
Except aren’t these Chinese models having to go big too? While they might not be Mythos/Fable sized, a trillion plus parameters is hardly a local server or even desktop to mainframe style jump
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hadlock on Monday July 20, 2026 @01:18PM (#48981775)
I've had 2b models give a plausible Paris vacation itinerary. A tools-capable 12b and especially 30b model from 2026 is certainly capable of producing passable results. I was demonstrating the qwen 3.6 27b model I stood up last week to my wife and it gave her a passable Moroccan Chicken recipe. With tool calling (search) they're quite good.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alex43578 on Monday July 20, 2026 @01:39PM (#48982105)
With OpenAI having released 20 and 120B models a while back, I think they recognized that tiny models were never going to be a defensible income stream.

Any value will come from the largest models, and those largest models are unlikely to ever run on consumer hardware within their window of relevancy.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by vitally3643 on Monday July 20, 2026 @02:40PM (#48983045)
You're missing the point. You very rarely need the biggest and "best" model. This is psychology and nothing more, people always want the "best" and don't often consider "good enough".

Small models are good enough depending on your task. That's the point. A model you can run on your phone or laptop is an incredibly useful tool for a lot of problems even though it isn't the "best" theoretically possible model.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:49PM (#48983973)
Yep.

And firms will be kept in check with financials.

If your competitor starts using chinese models and delivers better earnings whilst you are spending more on american ones... hahaaha. Wait and see what happens.

You will be FIRED!

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alex43578 on Monday July 20, 2026 @04:29PM (#48984469)
You're missing the point: those small "good enough" models aren't monetizable and haven't been for months already. All of the value in LLMs is going to come from frontier models at a high cost to businesses/governments. It'll be the difference between next day air-mail of a contract and sticking a stamp on your christmas card to Grandma - nobody's making a profit on the christmas card.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hadlock on Monday July 20, 2026 @07:56PM (#48986429)
I suspect in 5 years everyone will have the equivalent of a 512gb mac mini running a 500b class open weight model for 98% of their tasks, shelling out to openai/anthropic for the other 2%. People who need higher end models will own the equivalent of 4 x 512gb mac mini running a 2.8T class open weight model. I don't know where OpenAI and Anthropic are going to get their revenue from to keep developing SOTA frontier models at that point.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by Paradigma11 on Monday July 20, 2026 @04:39PM (#48984594)
How often do you need the task to turn out harder than you anticipate and the small model unexpectedly failing to change the calculation?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by applicative on Monday July 20, 2026 @01:29PM (#48981981)
It’s AI talking about AI so cum grano salis, but my AI is saying I would need at least a half million dollar in hardware to run the newer high quality Chinese models with bemchmark-competitive force.

You can run a Moroccan chicken fragment on the cheap in homage to what you cannot run

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by josephcooney on Monday July 20, 2026 @05:21PM (#48985020)
I was on a long international flight recently with no internet and Google AI Edge Gallery installed on my phone with a 2.5GB quantized version of Gemma 4 on it. I was able to chat to it for a while and get some information about my destination which all turned out to be true and good advice.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by doctoboggan on Monday July 20, 2026 @12:37PM (#48981218)
I think the SotA is moving too fast for the production timelines of an ASIC, wouldn't you think? People are just now coming out with LLAMA ASICS but who would want to use LLAMA? Or I guess you are arguing that the models _now_ will be durably useful enough to commit the time to creating the ASIC?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by xtracto on Monday July 20, 2026 @03:54PM (#48984053)
I dream of some kind of "adjustable" ASIC layers, that have the most "computation demanding" layers as ASICs plus a bunch of configurable R+W circuits (FPGAs?) that can be written to upgrade the models to some extent.

What's fascinating is that we are pushing the state of the art of hardware at this point.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JohnBooty on Monday July 20, 2026 @01:43PM (#48982149)

    guess you are arguing that the models _now_ will 
    be durably useful enough to commit the time to 
    creating the ASIC?
Objectively, the current frontier-ish models will be useful for some time. Imagine the zombie apocolypse hits, recedes, and you need to rebuild society. An offline copy of Fable or even Opus would be a nice thing to have.

Subjectively, it's hard to say if people will pay for "a model from 18 months ago, but REALLY FAST AND CHEAP"

The speed difference suggests some use cases that might narrow the performance gap. With a > 50x performance delta you have some headroom to play with.

You can do many many fast iterations of ye olde "Ralph loops." You can also jack up the reasoning/effort level. And you could probably do some combination of both, while still running really fast ie 10x the number of iterations at 2x reasoning/effort.

So I think a hypothetical "50x faster Opus 4.8, but burned into ASICs" could be pretty competitive against the frontier models from 2027, 2028, 2029, and maybe beyond?

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by searealist on Monday July 20, 2026 @12:37PM (#48981221)
How does an ASIC manage to have 60x the memory bandwidth needed to achieve that speedup?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @01:11PM (#48981677)
Currently the setup is paged view in RAM shuttled to HBDRAM (VRAM) on the GPU, which in turn has to get materialized piece by piece onto cache SRAM on the GPU.

Cerebras tries to get around this by keeping everything on cache SRAM as much as possible, which it burns directly to the chip wafer itself and physically places that SRAM directly next to the tiny compute unit that does the actual math.

An ideal setup (not sure how easy this is to achieve in practice), is the burn the weights of the model directly to the chip as a sort of ROM, the actual math operations as actual digital circuits, and have SRAM, or even something akin to naked registers to directly compute off inference batch data. Cuts out 2-3 layers of abstraction and indirection.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by oblio on Monday July 20, 2026 @05:19PM (#48985009)
I assume ROM would be even more expensive than SRAM?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @01:17PM (#48981763)
You don't need memory because the output of the previous layer flows directly into the input gates of the next. So no I/O to/from HBM or similar

You still need some memory for the context, in flight answers, ... but not for the model weights and for the output of the intermediate layers. I found taalas demo here: https://chatjimmy.ai/

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by throw1234567891 on Monday July 20, 2026 @12:49PM (#48981386)
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by wongarsu on Monday July 20, 2026 @12:54PM (#48981452)
While running the model at 9000 tokens/s is the more flashy demo, I imagine running 1000 concurrent requests at 150 tokens/s each is the much more achievable goal
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @02:14PM (#48982641)
At 9000 tokens/s you could interleave a lot of requests so long as pre-fill is also fast. It really depends on how much you need to keep sessions open to take advantage of KV caching
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by wyre on Monday July 20, 2026 @01:39PM (#48982112)
It depends. If I was running a model locally I would much prefer 9000 t/s. If I was running an inference company, obv 1000 concurrent requests at 150 t/s is preferable.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:08PM (#48981632)
What precisely is an ASIC supposed to do that a more programmable accelerator can't? Memory latency is memory latency: doesn't matter whether it's embedded in a cache-line wait state or some flipflop state machine. ROM isn't going to be faster than RAM either.

Likewise, for compute, is the ASIC somehow going to beat a systolic array? You can't have one circuit per weight: the die area and electrical fan-out would be insane. I'm not seeing how an ASIC specialized for a specific model would actually help much.

I mean, sure, we can build more specific accelerators, e.g. for softmax, but these work fine in the context of a programmable pipeline.

Yes, there are more exotic things out there, like optical matrix multiplication systems. Those are different. But above, aren't you talking about just doing conventional digital linear algebra, but with a model-specific set of circuits?

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @01:19PM (#48981810)
No, if you burn your model into the silicon you don't need memory as the output of a layer flows through circuitry directly into the next one. No I/O to memory of any kind. You still need a bit of memory for in flight answers, but that's it.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by quotemstr on Monday July 20, 2026 @01:31PM (#48982009)
You can pipeline in software too, and even with a dedicated circuit, you need to put weights somewhere, because you're not going to have a special partially-applied FP8 FMA unit for each of your trillion model weights.

I can accept the idea of specializing a circuit for a specific model shape, but I'm not seeing a need to specialize a circuit for the weights inside the shape.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by marcyb5st on Monday July 20, 2026 @03:14PM (#48983535)
Apparently that is what Taalas did though. Not an hardware person, so take this with a pinch of salt
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by applicative on Monday July 20, 2026 @01:19PM (#48981807)
Open weights are a red herring if you can’t run the model independently. Good luck fitting these models on your Mac mini.

In fact the superior models are irreducibly nothing but superior web services run from China.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by Slartie on Monday July 20, 2026 @01:36PM (#48982074)
Did you not notice that there are inference providers running all the various Chinese open weight models in the US and EU?

Nobody needs "web services run from China" to use Chinese open weight models.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hughw on Monday July 20, 2026 @01:26PM (#48981936)

  A Fable 5 model running at 9,000 tokens/s on an ASIC rather than 150 tokens/s on electricity chugging Nvidia GPUs, or even giant SRAM Cerebras or Groq chips could be good enough to meet the majority of demand.
640K ought to be enough for anybody.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JacobAsmuth on Monday July 20, 2026 @02:12PM (#48982612)
Agreed 100%. This guy thinks there's a limit on the demand for intelligence. You think that Fable 7 which can run a billion dollar corporation on its own has no consumer demand just because we have fable 5 at 9k tok/s? Who do you think will be the biggest customer of such a model? Fable 7, obviously.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by LarsDu88 on Monday July 20, 2026 @02:21PM (#48982781)
Certainly there will be demand for Fable7, but that demand is context specific. Frontier labs' profit is dependent on there being sufficient demand for the next layer of capability and whether the premium consumers are willing to pay for that.

The incremental unlock of capability by ever increasing frontier model sizes will eventually reach diminishing returns.

I would argue tnference speed increases would actually unlock a different kind of more meaningful value for a wider audience.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by drob518 on Monday July 20, 2026 @02:25PM (#48982837)
Of course not. But many tasks won’t require Fable 7 level intelligence and many people won’t want to pay for it. Honestly, I’m using Deepseek v4 Flash a LOT lately to do more mundane tasks because it’s so nearly free and I don’t need Fable or even Opus. Serving those mid-level models at high speeds and low prices is a definite winner for lots of applications. And sure, the frontier models will continue to drive the frontier forward.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sdfefcxv on Monday July 20, 2026 @03:57PM (#48984089)
theoretically theres a no limit on the demand of anything if the price is right

pretty stupid statement lmao

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by JacobAsmuth on Tuesday July 21, 2026 @02:27PM (#48996164)
Marco econ 101 disagrees :) Ask your favorite LLM to explain the "yield curve" to you
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by jackb4040 on Monday July 20, 2026 @05:22PM (#48985038)
Sorry, which billion-dollar corporation is Fable running "on its own"?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by blep_ on Monday July 20, 2026 @10:08PM (#48987238)
Fable 7 isn't a thing, 5 is the one people are currently excited about. They're talking about a hypothetical more-advanced future version.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by aaronharnly on Monday July 20, 2026 @10:08PM (#48987245)
They imagined a "Fable 7" model (i.e. two generations hence) which would be capable of such feats.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by foobit-dev on Monday July 20, 2026 @05:34PM (#48985165)
> 640K ought to be enough for anybody.

I get this reference!

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by dymk on Monday July 20, 2026 @06:49PM (#48985861)
I am really confused about the point you're trying to make. 150tok/s is slow, but so is 9000tok/s? Or they're both fast? Or 150tok/s should be enough?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by oliyoung on Monday July 20, 2026 @07:04PM (#48985984)
The "640k should be enough for anyone" quote (even if Gates didn't exactly say it) is making the point is that _right now_ we have no idea about what our future needs and capabilities will be, we can't imagine what "should be enough" will be

640k was enough ... in 1981 ... almost fifty years later is 50,000 lower than a standard off the shelf PC now

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by dymk on Tuesday July 21, 2026 @02:09AM (#48988657)
If that’s the case I still don’t get it. 640k was enough in 1981, same as how 150 (or 9k) tok/sec would suffice for 2026

The comment seems like the nerd equivalent of 6 7

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by everyday7732 on Tuesday July 21, 2026 @08:45AM (#48991616)
The original quote was supposedly Bill Gates saying that "640kb of memory should be enough for anyone".

The quote became famous because it's a failure to imagine that people would find new uses for computer memory if it became plentiful and cheap. In the quote Gates is not expecting people to come up with more demanding applications for computer memory (RAM) than the ones which were available in 1981.

Computer memory did in fact become plentiful and cheap after this, and computer programs became more complex and memory-hungry and today we wouldn't consider a 640kb an acceptable amount of ram for even the lowest-end device.

OP is repeating the quote about memory to indicate that they think that modern LLMs will be a similar resource. We should not expect that demand for LLM inference will stay flat, and that once everyone has cheap access to Fable level, we won't find new more demanding uses for it.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by hughw on Monday July 20, 2026 @06:51PM (#48985880)
probably no number you come up with will be adequate for very long. [edit] it's a reference to this possibly apocryphal prediction https://www.computerworld.com/article/1563853/the-640k-quote...
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by stickfigure on Tuesday July 21, 2026 @03:34PM (#48997092)
> 640K ought to be enough for anybody.

The question is really whether 640k is enough to last you until your next hardware upgrade.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by faitswulff on Monday July 20, 2026 @03:02PM (#48983373)
Another reason this may be true, selling hardware may be the only durable moat after a while
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by mullingitover on Monday July 20, 2026 @03:04PM (#48983396)
> the winner will be whoever burns their models to ASICs fastest.

It'll obviously be China, and they won't need the bleeding edge of lithography tech to make it happen. Every Chinese smartphone will have something like Sonnet 5, along your car (well, not those of us in the US, but we'll look longingly at pictures of them while we drive whatever the government decides we're allowed to drive in Fortress America).

Give it ten years and your smart litterbox from Temu will be running its own local model.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by adventured on Tuesday July 21, 2026 @12:22AM (#48988023)
China won in desktop PCs? Nope.

China won in cloud services? Nope, not even close. They had to clone AWS just to try to keep up.

China won in mobile? Nope. Although they're very competitive there.

China won in search? Nope. Baidu who?

China won in ecommerce? Nope. Their dominance is overwhelmingly domestic.

China won in software? Nope. Windows is US. Android is US. iOS is US. MacOS is US. Linux is US/Europe/Global. Look at the top 50 largest software companies.

China won in silicon? Nope. Look at the top 50 companies.

China won in .... India and Latin America can manufacture iPhones now.

But sure, China's the obvious winner this time. Good luck.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by mullingitover on Tuesday July 21, 2026 @05:47PM (#48998820)
India and Latin America doing some final assembly is kind of a whimper of a counterpoint.

Most of this litany is trivially refuted by pointing out that roughly 40% of the world's declared 5G Standard Essential Patents were developed in China. The only reason they don't completely dominate telecom globally is the panicked invocation of national security fears to erect emergency trade barriers.

"China won in ecommerce? Nope. Their dominance is overwhelmingly domestic."

Their domestic ecommerce market eclipses the US and the next several biggest markets combined. You can argue protectionism, but then you have to face the reality that the US is doing its own flailing protectionism today.

Generally, this is an embarrassing category error of an argument. Running models on ASICs, IoT devices, and EVs are infrastructure and hardware plays: areas where China is inarguably so good that it's a problem.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by aaroninsf on Monday July 20, 2026 @03:14PM (#48983536)
Apple's M7 comes to mind...
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by seydor on Monday July 20, 2026 @03:33PM (#48983785)
They require a lot of computation regardless of whether this will take place on ASICs. China can do it, even if the chips are not the most power-efficient. They have built lots of electricity capacity.

Ultimately however, that just means that models will become dirt-cheap. The money will be made with applications built on top of the models.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by chermi on Monday July 20, 2026 @03:39PM (#48983866)
My gut is that, at least for now, there's a timescale mis-match problem. Hardware still takes too long, then you have to deploy it. I don't know much about "burning asics", but if the whole process of spinning up programmable GPU data centers is months, I imagine the whole ASIC cycle has some catching up to do. To be clear, by timescale mismatch I mean model quality improvement timescale vs. deployment timescale. But maybe we're finally getting to the point where behind-the-frontier-but-cheaper are in sufficient demand and ASICs make it cheap enough to close that gap.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by zdragnar on Monday July 20, 2026 @04:09PM (#48984239)
If Qwen 3 Coder were available as a PCI card I could just slot into my desktop, and the software on the system could recognize the card and still work with other cards should I decide I later want to upgrade to Qwen 5 or whatever, and at a three figure price point, I imagine it would do quite well.

The comparison I've seen elsewhere is the old console systems with separate cartridges for games... I wouldn't want to be regularly swapping them, but if they came out in a form factor that didn't require me to shell out multiple-4 digit figures in upgrades just to use the next model, it'd easily be worth it for me.

I've already got a home lab, and it's specced to last, minus the GPU. I picked up a separate system for local llm experimentation, but I'm not likely to be upgrading it again. The value add is incredibly small compared to the cost. The real benefits are data privacy and never worrying about rate limits, and there's a price point beyond which an incremental improvement to the model doesn't justify upgrading the system.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by chermi on Monday July 20, 2026 @06:48PM (#48985857)
Wow having it as a PCI card would be awesome. I don't know the feasiblity but it would be really cool. Ordering different models, back to physical media basically...
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by snarfy on Monday July 20, 2026 @04:03PM (#48984167)
I'm convinced there is a Transmeta/transpiler solution somewhere between 9000 t/s ASIC and Nvidia GPUs. LLMs fit the model much better than what they were trying to do with general purpose in the 2000s.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by sarchertech on Monday July 20, 2026 @04:18PM (#48984333)
> Does anyone think we need a Mythos level model to plan a road trip

Yes. The latest OpenAI and Anthropic models are terrible at planning roadtrips.

This is something I try to use them for frequently. They constantly get things completely wrong.

I’d say that about half of the stops they suggest fail to follow whatever filters I’ve asked for.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by jrs100000 on Monday July 20, 2026 @06:09PM (#48985502)
Fable is a pretty crappy general purpose LLM. It reminds me a little bit of GPT 5.2, in that it sometimes gets argumentative and deceptive after being caught in a mistake, and it tends to make a lot of them when you ask for judgement calls. Opus 4.8 is better for that sort of thing, or Opus 4.6 if it's important that it actually follow all of your instructions.

And this is one of the big things that seems to be missed in these discussions: There is no longer a universal linear trend of LLMs being 'better' each iteration. They are becoming more specialized, and ones that approach problems from a different angle (like Fable/Mythos) can appear breakthrough when first released, but we don't appear to be on a path that actually leads to general purpose hyper intelligence.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by daadx on Monday July 20, 2026 @07:50PM (#48986381)
There never was a path.

It was nonsense to draw in investment and justify an inflated valuation.

lmao

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by paxys on Monday July 20, 2026 @04:32PM (#48984509)
The field is moving too fast for it to make sense. ASICs have a 12-24 month development cycle and you’d have to throw them in the trash 4 months later.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by jackb4040 on Monday July 20, 2026 @05:25PM (#48985072)
If this approach doesn't include a way to apply updated finetunes on a daily basis (also without going back to VRAM being the bottleneck) then the trash interval would be measured in hours, not months
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by dboreham on Monday July 20, 2026 @05:13PM (#48984954)
GPUs are already ASICs.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by knicholes on Monday July 20, 2026 @05:33PM (#48985160)
We're getting new models every three months. They'd have to work quickly to get those chips made and installed.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by jv22222 on Monday July 20, 2026 @06:38PM (#48985762)
Yeah, I have been thinking exactly the same. Makes all the sense in the world and is inevitable as far as I can see.

https://news.ycombinator.com/item?id=48464958

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by throwawayffffas on Monday July 20, 2026 @06:58PM (#48985944)
> whoever burns their models to ASICs fastest.

There is already custom hardware see cerebras.

GPUs have a lot of slack there is at least one lab that had a (small 8b) model generate almost 3000 tokens per second on a MI300X for a talk, instead of the typical software stack that did maybe 100ish tokens per second.

High bandwidth flash storage is in the works, i.e hard drives with TBs of storage and over 1 TB per second of read speeds. Meaning that in a couple of years you may be able to buy a card with 40-90GBs of HBM and 4TB of HBF and run a 3T model locally at a reasonable speed for 10-20k as opposed to a cool mil.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by topspin on Tuesday July 21, 2026 @12:47AM (#48988154)
> Meaning that in a couple of years you may

There is no "may" here. You will see this.

It's always difficult to see it from the present, but we're not at some end stage in hardware development; we're still on the same curve our predecessors also couldn't see: they couldn't imagine that there would be high performance computers carried in our pockets, with staggering amounts of storage and compute, putting to shame the machines they filled rooms with.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by throwawayffffas on Tuesday July 21, 2026 @04:01AM (#48989428)
Oh yeah the may is on the 2 year time horizon. It could be 3 or 4. Or next year.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by topspin on Tuesday July 21, 2026 @01:50PM (#48995692)
Yes, the timelines are highly uncertain, but the AI boom and AI money are reinvigorating the entire fabrication ecosystem from top to bottom and causing innovation where there had only been incremental progress for years. People aren't just thinking about their node schedule and yields: they're pursuing radical new designs with far greater urgency.

That's where OpenAI in a box is going to come from. And it won't take long.

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by signa11 on Monday July 20, 2026 @07:46PM (#48986355)
why not start with fogas ? you know … to test the waters ?
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by alach11 on Monday July 20, 2026 @07:49PM (#48986377)
> the winner will be whoever burns their models to ASICs fastest

As of today, that appears to be Google!

https://news.ycombinator.com/item?id=48986351

Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling by Havoc on Monday July 20, 2026 @08:11PM (#48986571)
Fun as the asic play would be it has a giant hole - context storage. Raw speed only gets you so far if you can’t store and cache