Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by misiti3780 on Monday July 20, 2026 @12:16PM
(#48980920)
is anyone doing this ?
[ Parent
| on HN ]
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by LarsDu88 on Monday July 20, 2026 @12:20PM
(#48980974)
The closest example I've seen is ChatJimmy: https://chatjimmy.ai/ a prototype from Taalas running Llama 8B
Scaling this up to 2.8 Trillion (350X increase), will certainly be challenging.
If I was younger and had the right background, I'd love to dive into attempting somethign like this
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by selectodude on Monday July 20, 2026 @01:41PM
(#48982126)
Also a 3-bit quant. Useable but a long long way away from useful.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by gopalv on Monday July 20, 2026 @12:44PM
(#48981330)
Taalas HC1 is the closest thing to this.
Last I saw they posted Deepseek R1 numbers in Feb of this year.
The challenge is rolling out a new one every 7-8 weeks as the weights change & cheap enough for a hyper scaler to afford to buy one and save enough on power over the next 8 weeks as a payoff.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by 535188B17C93743 on Monday July 20, 2026 @12:51PM
(#48981415)
Yeah, I've heard of Taalas doing it. Not sure of others but I'm sure lots of companies are considering it, especially as we start to hit points of depreciating returns in training.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by carterschonwald on Monday July 20, 2026 @12:20PM
(#48980976)
not sure about that, but im actively working on designing ultra sparse models that i want to have perform competitively with stuff 100-10_000 times larger. ehich does yield similar throughput. time will tell id it works out
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by eckr on Monday July 20, 2026 @12:20PM
(#48980978)
There was a startup that did this for Llama 3, I forgot their name. Etched is also doing some similar things I believe.
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by robgough on Monday July 20, 2026 @12:22PM
(#48981002)
obligatory link to https://chatjimmy.ai
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by hnfong on Monday July 20, 2026 @12:35PM
(#48981199)
It sounds vaguely similar to what Cerebras.ai is doing
Re:Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
by alach11 on Monday July 20, 2026 @07:50PM
(#48986382)
News just broke today that Google is planning on doing this:
https://news.ycombinator.com/item?id=48986351